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(57) Abstract: A method of developing 
an interactive system, including inputting 
application data representative of an 
application for the system, the application 
data including operations and parameters 
for the application, generating prompts 
on die basis of the application data, 
and generating grammar on the basis of 
the application data. The prompts and 
grammar are generated on the basis of 
a predetermined pattern or structure for 
the prompts and grammar. The grammar 
also includes predefined grammar. 
Grammatical inference is also executed to 
enhance the grammar. The grammatical 
inference method for developing the 
grammar may include processing rules 
of the grammar, creating additional 
rules representative of repeated phrases, 
and merging equivaJent symbols of the 
grammar, wherein the rules define slots 
to represent data on which an interactive 
system executes operations and include 
symbols representing at least a phrase 
or term. The grammar is hierarchical 
and the rules include a reference count 
representing the number of other rules 
that reference the rule. Additional rules to 
be created during grammatical inference 
are determined on the basis of attribute 
constraints. 
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A METHOD OF DEVELOPING AN INTERACTIVE SYSTEM 

The present invention relates to a method of developing an interactive system and, in 
particular to a development system and tools for generating an application for an interactive 

system. 

Interactive systems, such as interactive voice response systems (IVRs), are able to 
communicate with other machines or. humans using natural language dialogue. The systems 
are able to prompt a communicating parry for data required to execute application tasks and 
need to cater for a wide variety of possible responses to the prompts, particularly when 
communicating with humans. Developing a set of rules which defines all of the possible 
answers or responses to the prompts is particularly problematic and labour intensive. Also 
developing a structure to manage the dialogue which occurs between the communicating 
parties, is complex. Accordingly, it is desired to provide a method and tools which facilitates 
application development or at least provides a useful alternative. 

In accordance with the present invention there is provided a method of developing an 
interactive system, including: 

inputting application data representative of an application for said system, said 
application data including operations and parameters for said application; 

generating prompts on the basis of said application data; and 

generating grammar on the basis of said application data. 

The present invention also provides a system for developing an interactive system, 
including: 

means for inputting application data representative of an application for said system, 
said application data including operations and parameters for said application; 
means for generating prompts on the basis of said application data: and 
means for generating grammar on the basis of said application data. 
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The present invention also provides development tools for an interactive system, 
including: 

code for inputting application data representative of an application for said system, 
said application data including operations and parameters for said application; 
code for generating prompts on the basis of said application data; and 
code for generating grammar on the basis of said application data. 

The present invention also provides a grammatical inference method for developing 
grammar, including processing rules of the grammar, attaching slot specification rules 
representing meaning, creating additional rules representative of repeated phrases, and merging 
equivalent symbols of the grammar. 

Preferred embodiments of the present invention are hereinafter described, by way of 
example oniy : with reference to the accompanying drawings, wherein: 

Figure 1 is a block diagram of a preferred embodiment of an interactive system 
connected to a communications network: 

Figure 2 is a more detailed block diagram of the interactive system: 

Figure 3 is a preferred embodiment of a development system for the interactive system; 

Figure 4 is a flow diagram of a model merging process of the development system; 

Figure 5 is a now diagram of an incorporation phase of the model merging process; 

Figure 6 is a flow diagram of a slot specification rule substitution process of the model 
merging process: 

Figure 7 is a schematic diagram illustrating appending a grammar symbol: 
Figure 8 is a flow diagram of a recurrence procedure; and 
Figure 9 is a flow diagram of a traverse node procedure. 

An interactive system, as shown in Figure L is able to communicate with another 
party, being a human or machine, using a natural language dialogue. A communication path 
is established with the parry over a communications network 4, such as the PSTN and/or 
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Internet. The path is between the system 2 and a communications terminal, such as a standard 
telephone 6 or computer system 8. When the communicating party is human and a voice 
terminal, such as the telephone 6, is used the system 2 converts prompts for the party to speech 
for delivery to the terminal, and interprets speech received from the terminal. When 
communicating with a machine, such as the computer 8, text data representative of the 
prompts and responses can be passed between the machines 2 and 8. The architecture of the 
system 2 can be considered to be divided into three distinct layers 10 to 14, an application 
layer 10, a natural language processing layer 12 and a signal processing layer 14. The 
application layer 10 defines an application for the system 2, such as a bill payment service, a 
customer service operation or a sales service. The application identifies the operations and 
transactions to be executed by the system 2. The natural language processing layer 12 defines 
the prompts to be generated by the system 2, the grammar which is acceptable in return and 
the different operation states and state transitions of the system 2. The signal processing layer 
14 handles the communications interface with the network 4, the terminals 6 and 8, and the 
data processing required for the interface, such as speech generation and recognition. 

The natural language process layer 12. as shown in Figure 2. includes a finite state 
machine (FSM) 20. the prompts 22 and the grammar 24. The FSM 20 controls the states for 
the system 2 and the state transition and accordingly controls the decisions and tasks executed 
by the system 2. The FSM 20 effectively performs dialogue management for the system 2, so 
as to control selective transmission of the prompts 22 and act in response to the grammar 24. 
The prompts 22 are words of questions which can be sent by the system 2. The grammar 24 
is a set of rules stipulating words and/or phrases which form acceptable answers to the 
prompts. The rules also define slots in the answers which constitute parameters required by 
the FSM 20 for execution of decisions and tasks. Accordingly, the slots are also defined in the 
FSM 20. The prompts, on instruction from the FSM 20, are selectively passed to a speech 
generator 26 for conversion into speech or voice and transmission to the terminals 6 or 8 using 
a communications interface 30 of the system 2. Responses received from a party are received 
by the communications interface 30 and- are converted to representative data by a speech 
recognition module 28. The response data is passed by the module 28 to the grammar 24 for 
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processing. The grammar 24 interprets the responses and passes operation instructions and 
operation data from the slots to the FSM 20. 

The interactive system 2 may take a number of forms, as will be understood by those 
5 skilled in the art, ranging from a hand held mobile device to a distributed computer system. 
For simplicity, the preferred embodiments are described hereinafter with reference to the 
interactive system being an IVR. IVRs are produced by a number of telecommunications 
equipment providers, for example the Voice Processing Service (VPS) by Periphonics Inc. The 
pans 26, 28 and 30 of the signal processing layer are normally standard hardware and software 
0 components provided with the IVR. A developer would then be required to define at length 
program code, which can be compiled or interpreted, for the components 20, 22 and 24 of the 
prompt layer 12. Tliis is an extremely onerous task which the preferred embodiments seek to 
alleviate. The speech recognition accuracy obtained by the system is also dependent on the 
coverage of the grammar. If it is too broad recognition may degrade, and if it is too narrow, 
5 recognition performance will also be degraded by trying to match an unexpected phrase against 
a list of encrypted phrases. The preferred embodiments also seek to obtain optimal speech 
recognition accuracy early in the applications life cycle by learning grammars from examples 
and using prior knowledge. 

) A development system 40, as shown in Figure 3, includes an application generator 42 

which operates on an application file 44 to generate an FSM 20, prompts 22 and grammar 24. 
The grammar 24 is refined by a grammatical inference engine 46. The application file 44 can 
be considered to define the application layer 10. The file 44 includes semantic data which 
describes semantics to be used in the rVR 2. The file defines the operations to be executed by 
the system 2 and the parameters required to execute the operations. An example of an 
application file 44 for a stock trading application is shown in Appendix 1. The operations 
defined are "buy", "sell" and "quote". The operations each have a number of input parameters 
defined by a parameter name and a number of output or return parameters defined by a return 
name, with all of the parameters being allocated a parameter type. The parameter types are 
predefined in an extendible type library. Tins library can be extended using a type definition 
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file, a grammar file and a slots file, as described heretnafter, and may Inc , u de tntegers real 
numbers, dates, times and money amounts. Parameters types can a ,so be defined bv the 
deve.oper in a list of items. The example of Appendix 1 includes a list of stocks to be used by 
the apphcation. A list of hems may be products, companies, options or any item of interest 
5 The operations "sell" and "quote" are defined as requiring a user to be prompted to confirm 
that the mput parameters are correct before proceeding with the operation. The application file 
cah also be used to define additional information that can be obtained from a user of the FVR 
such as a user's account number and PIN. Initial data such as this can be considered to be 
preamble parameters which are collected before a top-level state of the FSM 20 is entered and 
1 0 are used as global variables. Global vanab.es for the 1 VR 2 are used in al. operations of the 
IVR. The names of the operations are used in the grammar 24 a, keywords to signifv execution 
of the operation. For example, a user may respond to a prompt by saying "self or "sell all my 
holdings in BMP". 



15 



20 



The finite state machine 20, the prompts 22 and the grammar 24 generated bv the 
apphcation generator 42 on the basts of the apphcation file 44 of Appendix . are shown in 
Appends 2, 3 and 5. respectively. A slot is defined for each input parameter name as we., 
as a slot for "operation". The slots are therefore operat.on, s.ockname. number and price 



The fimte state machine 20 of the stock trading example is written in the ITUs 
Specification Description Language (SDL) of the ITU. The FSM 20 includes a number of 
procedures with vanables. and arc similar to subroutines in that a stack is used to control each 
procedure's behaviour, yet, a procedure can mc.ude states. An FSM 20 is generated by the 
application generator 42 executing the following steps: 
25 (a) Create an initial top-level state. 

(b) For each operation of the apphcation file 44 create a state transit.on from the 
top-level state. 

(c) For each parameter create a variable. The name of the variable is globally 
untque, which is achieved by pre-pending the operation name to the parameter 



30 



name. 
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(d) For each state transition related to an operation, set all input parameters that 
may be obtained in a first response from a user to a value, otherwise reset the 
parameters to a value representing "null" or "unknown". A call is made to a 
nested state machine, such as an SDL procedure, to check each parameter in 
turn. If an operation needs to be confirmed, a procedure is established to ask 
the user for confirmation, otherwise the operation is executed. The results of 
the operation are passed to the output parameters and forwarded to the user 
prior to returning to the top-level state. 

(e) A number of procedures are established for generic operations for I VRs. such 
as help, cancel, repeat and operator. 

(0 For each input parameter that does not have a default, a nested procedure is 
established to determine if a parameter has been set to a value obtained by a 
response. If it is not set. a default is used. 

(g) For each input parameter a nested procedure is created to check if an incoming 
message or response sets a parameter. If the parameter is set in the incoming 
message, the variable relating to the parameter is set. 

(h) For each parameter that does not have a default, a nested procedure is created 
to see if the parameter has been already set. If it is not set. the procedure 
prompts the user for the parameter. 



The grammar 24, shown in Appendix 5, is in a format used by the preferred 
embodiment. This grammar is also repeated in the Nuance format in Appendix 6. Appendix 
7 shows an alternative grammar format using the Nuance format. The grammar has a 
hierarchical structure, similar to a tree structure, where the nodes can be considered to be 

25 symbols that are either terminal or non-terminal. A terminal symbol represents a specific word. 
A non-terminal symbol represents other symbols and can be expanded into a set of symbols 
using a rule of the grammar. A rule defines a relationship between a non-terminal and symbols 
it can represent. For example, buy, sell, cancel, repeat, help and quit are terminals, whereas 
CommonStockCmds and WaitAskbuystockname are non-terminals. A terminal is shown in 

30 the Appendix and herein as any string of characters beginning with lowercase letter. A 
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NonTerminal is any string of characters beginning with uppercase letter, whereas Feature & 
Value is any string of alphanumerics including '.' and lines beginning with ";" are comments. 

The syntax of the grammar format used by the preferred embodiment, in Backaus Naur 
Form, is shown in Appendix 4, and an example of this is given below: 

!S -> from Location* I on Date:x2 (10,1) { operation=fly from=$x I. location 
date.month=$x2.date.month date.year=$x2.date,vear date.dom=$x2.date.dom } 

In this example the '!' signifies that the rule is fixed and is not to be altered by any 
learning process. The symbol Location is a non-terminal and can be expanded into other 
symbols such as melbourne. This non-terminal Location returns a value. The returned value 
from the first instance of Location in the rule is stored in the xl variable and the second one 
into x2. There have been ten observations that use this rule and one other rule makes reference 
to this rule. The rule defines three slot specification rules that define the value the rule will 
return. The first states that the operation slot will always be set to the value 'fly'. The from slot 
is set the value of the location slot stored in the variable xl. The example above has us slot 
specification rules written in an absolute form. Alternatively a relative form can be used. The 
same rule written in relative form would be 

!S -> from Location* 1 on Date:x2 (10,1) { operation=f1y from=S2. location 
date.month=$4.date. month date.year=$4.date.year date.dom=$4.date.dom } 

In this form, instead of referencing variables such as x I or x2, reference is made to 
which symbol the slot value is extracted from. A third form is the non-terminal relative form 
which would be 

!S -> from Location* I on Date:x2 (10,1) { operation=fly from=#l. location 
date.month=#2.date.month date.year=#2.date.year date.dom=$2.date.dom } 

In this case the number represents the non-terminal index in the rule rather than the 
symbol index. 
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The grammar of Appendix 6 is the same grammar written in the Nuance grammar 
format. This is generated by executing the following steps: 

(a) For each state in the FSM 20 a top-level grammar is created. 

(b) For each top-level grammar a common set of commands are included, e.g. 
cancel, help, repeat and quit. 

(c) A non-terminal is created for each enumerated item from the application file 
44. 

(d) For each operation a non-terminal is created that represents that different words 
can be used to request that operation, and the operation name is placed into the 
non-terminal. 

(e) For the top-level grammar attached to the top-level state, e.g. TopLevel Slock, 
a non-terminal is added for each operation, to which is added a slot 
specification rule containing the operation slot. A slot specification rule or 
attribute is a set of key value pairs defining a slot value. For example the 
attribute "{(operation buy)}" is added to the non-terminal "GR_buv". 

(f) For each top-level grammar that corresponds to a state requesting an input 
parameter, a non-terminal is added that returns to the FSM an element of the 
requested type. Predefined rules are established for non-terminals that represent 
predefined types of parameters, e.g. money and integer. 

(g) For each non-terminal that is added to a top-level grammar, slot specification 
rules are added that pass the slots that are filled in the rules below the non- 
terminal to the top level rule. Input parameters may be either enumerated types, 
integers or data structures. For instance the data type date, may have a day of 
week, day of month, year and month slot. Where a parameter is a structured 
type, one slot specification rule is required for each member in the structure. 
For instance date.year=$x.date.year. To accommodate this conversion a type 
definition file is provided, an example of which is shown in Appendix 8. In 
addition to the type definition file, a grammar file is required to define a 
structured type. 
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(h) Predefined grammars are then attached to the generated grammar file to 
complete the application grammar file. These grammars are for the predefined 
types such as money or integer. An example grammar is shown in Appendix 
9. In these rules there is a T attached to the rules in the predefined grammar. 
This '!' is used to indicate that these rules are fixed and are not to be changed 
by subsequent grammatical inference. 

Appendix 10 is (he grammar generated by the process with the predefined grammars. 

The prompts 22 of Appendix 3 are generated from the application file 44 and for the 
example are written in the Clips language. The application generator 42 generates the prompts 
by executing the following steps: 

(a) The initial top-level prompt is set to be "Welcome to the stock application. 
Please say one of the following". The prompt then lists the names of the 
operations, e.g. "buy, sell or quote". 

(b) For die prompts where a parameter is being prompted for. a template associated 
with the parameter type is called and used to generate the prompt. Most of 
these prompts are in the form of "Please say the X'\ where X is the parameter- 
name. 

(c) For each state in the FSM, a help prompt can be played to the user if requested 
or if the FSM determines it is required. For prompts where the parameter being 
prompted for requires a corresponding help prompt, as determined by the 
parameter type, a template for help prompts associated with the parameter type 
is used to generate the prompt. These take the form of "Please say the X", 
where X is the parameter name and this is immediately followed by an 
example, such as "For example, three hundred and twenty five dollars and fifty 
cents". For enumerated parameters, the first three elements in the enumeration 
list can be used to form the example in the prompt. 
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The grammar generated by the application generator 42 can be significantly enhanced 
to cater for a wide variety of responses. A grammatical inference engine 46 is able to operate 
on response examples or observations to create additional grammars to extend the grammar 
24. The examples can be provided directly to the grammatical inference engine .46 from 
observations recorded by the IVR. Examples can also be provided from a symbolic inference 
engine 48 which can generates additional examples from the predefined grammar 24. The 
symbolic inference engine 48 uses a linguistic and/or symbolic manipulation to extend the 
examples, and can rely on synonyms or antonyms extracted from a thesaurus. The symbolic 
inference engine 48 may also accommodate cooperative responses, which may provide 
additional useful information to a prompt. For instance, the prompt may be "What time would 
you like to travel to Melbourne?", and a cooperative response would be "I want to go to 
Malvern not Melbourne". Another form of cooperative response is a pre-emptive response, 
such as to the prompt "Do you have a lax machine 1 could fax the information to?", the 
response may be "Yes my fax number is 9254 2770". Whilst a number of different 
grammatical inference engines could be used to extend the grammar 24, described below is 
a new model merging process 50 for grammatical inference that is particularly advantageous 
and efficient, and is executed by the engine 46. 

The model merging process 50 of the grammatical inference engine 46. as shown in 
Figure 4, operates on the grammar 24 and additional observations. 

The model merging process 50 is based on the following principles: 
(1) Whenever a high correlation between a sequence of two or more symbols and 
some slot specification rules is observed, a new non-terminal and rule are 
created. In representing the rule, the new non-terminal is placed on the left 
hand side of the rule and the observed repeated sequence of symbols on the 
right hand side, as shown below. The slot specification rules are attached to the 
new rule. All observed sequences of the symbols on the right hand side of the 
new rule in the grammar are replaced by the new non-terminal. This phrase 
creation will only occur when there is more than one instance of a repeated set 
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of phrases. The exception to this is for single words. If there is a high 
correlation between an attribute and a symbol, a new rule will be created. New 
rules are added in an order such that the rules with the most evidence are 
created first. 

(2) The new rule needs to be applied more than once. A rule which is created 
during a chunking process 52 is deleted, as discussed below, if it is not used 
more than once in parsing the observations and it is not a top-level rule. The 
exception to this rule is when the rule is of length one, and has slot 
specification rules attached to it. A top-level rule of a grammar has a non- 
terminal on the left hand side which represents the rule and resides at the 
highest level of the grammar. 

(3) In a merging phase 54 : merging evidence patterns, described below, are used 
to identify symbols used interchangeably in the observations. The process 
seeks two symbols used interchangeably in the same place in a sequence of 

15 words For merging io occur the rules need to have compatible slot 

specification rules, and the non-terminals have to return the same set of slots. 

(4) The rules are each allocated a hyperparameter which correlates to the number 
of times the rule is used for the observations parsed by the generated grammar. 
Probabilities for the rules can then be determined from the hyperparameters. 

20 The grammatical inference engine 46 continually changes the structure of the 

grammar 24, and the use of the hyperparameters significantly reduces the 
amount of computation required as opposed to having to calculate and store 
rule probabilities. The hyperparameters are also used to remove redundant 
rules, and ambiguity during a reestimation phase 302. A discussion on the use 

25 of hyperparameters to calculate rule probabilities for model merging is. 

provided in Andreas Stolcke, "Bayesian Learning of Probabilistic Language 
Models", 1996, Doctoral Dissertation, Department of Electrical Engineering 
and Computer Science, University of California, Berkeley, available at 
ftp://ftp.icsi. berkeley.edu/pub/ai/Slolcke/thesis. ps.z. 

30 
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To attach meaning to the phrases, the model merging process 50 is based on an 
assumption that all slot specification rules are assignment operators, and the result of applying 
slot specification rules to a production rule is visible on the observations. Also it is assumed 
that these slot specification rules are applied universally. Application of the assumptions 
5 enables the model merging process to learn beyond what it has seen or received and to 
generalise. Under the assumptions, each slot specification rule may contribute either a slot- 
value pair, or a value to (he observation. For instance given the two rules: 

S -> from Location: xi {I,]) { from«Sxl .from } 

Location -> melbourne [1,1) { f rom=melbourne } 

0 5 -> to Location::.:! ( J , I ;. ! co=$xl . from } 

(he observation "from melbourne" with the slots "from=melboume H can be generated. In this 
. example the first rule contributes the slots "from=melbourne" while the second rule 
contributes the value "melbourne". 

If the last two rules were used to generate the phrase "to melbourne" with the slots 
"to=melbourne M the second rule contributes the. value "melbourne" while (he third rule 
contributes the slots "to=melbourne". 

There are a number of ways to determine correlation between the slots contributed by 

1 a rule and the slots of an observation. If the event A is the event that a rule contributes a 
particular slot value pair or value, and the event B is that an observation generated using that 
particular rule possesses that slot value pair or value, then for error free data, P(B/A) = 1 
because event A implies event B. If A implies B. then not B implies not A. Using this 
technique the list of possible slot value pairs or values a rule contributes can be reduced, once 
a candidate rule is given. To do this the notation p=v is used to imply that a rule contributes 
the slot value pair f^v and the notation *=v to imply that a Rile contributes the value v. 

Given a particular set of rules, and observations generated using those rules, and the 
attributes attached to the rules a set of slot value pairs and slot values can be determined that 
a rule can contribute. This is done as follows: 
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1 For every slot value pair f=v attached to an observation, add the set of potential 
slot values and values contributed by a rule to be { f=v, *=v } This set is 
known as the set of attribute constraints of the observation. 

2. The attribute constraints of a rule is the intersection of all of the attribute 
constraints of the observations that arc generated by that rule. The attribute 
constraints can then be converted to slot specification rules. The actual slot 
specification rules will most likely be a subset of the slot specification rules 
obtained from the attribute constraints. This is because when A implies B then 
not B implies not A but B does not imply A. 

In the more general case when a grammar is learnt from examples, and there is no 
starting grammar, the actual rules are unknown. To overcome this problem candidate rules 
with right hand sides of length one and two can be considered. Once a grammar has been 
constructed with rules of length one and two. longer rules can be constructed by representing 
them as rules of length two. where one or more of the symbols on the right hand side can be 
expanded into more symbols. 

This technique works best when there is no errors in the tagging of the data. An 
extension of the process would involve using P(A/D) - 1 , i.e. for instance P(A/B) = 0.9. 

The model merging process 50 has live distinct phases, an incorporation phase 300, 
a chunking phase 52, a pruning phase 301 .a merging phase 54 and a reestimation phase 302, 
as shown in Figure 4. Dunng the incorporation phase 300, as shown in Figure 5, the grammar 
is extended to include previously unpredicted phrases. A list of observed phrases 
(observations) is presented to the grammatical inference engine, at step 402, along with the 
dialog state that the phrases were collected in, plus a set of slots. The phrases are then parsed 
at step 404 by the grammatical inference engine using a bottom up chart parser. If the phrase 
can be parsed, the parser attaches a meaning to the phrase in the form of a set of attribute slots. 
If the meaning attached to the observation is the same as that attached to it by the parser, the 
grammar does not need to be extended to incorporate the phrase. If the meaning is not the 
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same r then an error will be flagged, at step 406, the user alerted and the execution halted. If 
the observation cannot be parsed using the existing grammar, the grammar needs to be 
extended to incorporate it. For instance the phrase 

"buy three hundred shares of abador gold for three dollars fifty a share" was observed 
once in the dialog state , TopLevelStock M with the slots { operation=buy, stockjiarne='*abador 
gold M price. dollars=3 price. cents=0 price. modifer=per_share } 

This could be added to the grammar as a new rule as follows: 

. TcpLeveiStock buy three hundred shares of abador gold for three 
dollars fifty a share (.1,1) opera tion=buy, stcckname="abador gold " 
price . doiiars=3 price . cents=0 price . modi f er=per_share 

However it is more advantageous to first generalise the rule, using a bottom-up partial 
parser, so that a rule of the form. 

.TupLeveiStock -> buy Number of St cckName : >:2 for Money: x3 a 
share (1,1) opera L icn-buy. s \ocki\au\e = S>:2 . s tcckname 
pr ice. dolls rs«Sx3. price.de: l.ars price . cenr.s=5x 3. price, cents 
price . modi fer=per_share 

The observation is partially parsed, at step 408. This creates a small number of parse 
trees., which return slot values. Where partial parses overlap preference is given to longer parse 
trees, with a left to right bias. These slot definitions are substituted into the slot definitions of 
the observations, one at a time, from the left to right, using the slot specification rule 
substitution process 410. as shown in Figure 6. This process is also used in the chunking 
phase. 

The slot specification rule substitution process can be used to substitute slot 
specification rules attached to rules with one. two or zero symbols on the right hand side. In 
the case where it is being used for substituting in new rules, created from observations, the 
new rule will have only explicit slot specification rules, i.e. x=y and none of the form x=$y.z. 
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The slot specification rule substitution process takes five parameters and makes 
reference to a type manager object, that defines the types of all of the slots used in the 
grammar. 

The five parameters are the slot specification rules of the rule being substituted into, 
the slot specification rules of the rule that is being referenced, the symbol on the left hand side 
of the rule that is being referenced, and the variables attached to the first and second symbols 
on the right hand side of the rule that' is being referenced in the rule that is being substituted 
into. Under certain circumstances these last three symbols can be undefined. For instance 
where the rule that is being referenced has only one symbol on it right hand side, the second 
symbol is marked as undefined. 

For instance the rule being .substituted into may be 

S -> I warn to fly from CITV:x to ClTY.y (1,1) { note=tellfrom from=$x.city 
to=$y.city } 



While the rule being referenced mav be 

XI -> from CITY:x (1,1) { city=Sx.city note=tellfrom } 

In this case the slot specification rules of the rule that is being substituted into would 
{ from=$x.city to=Sy.city note=te!lfrom } 

the slot specification rules of the rule that is being referenced would be 
{ city=$x.city note=tellfrom } 

the symbol on the left hand side of the rule would be XI 

the first symbol would be "from" and second symbols would be "CITY", 

therefore the two variables referencing these symbols are undefined and x respectively. 



be 
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Each slot definition rule attached to the rule being substituted into is examined one at 
a time. If it refers to one of the symbols on the right hand side of the rule that is being 
referenced, it needs to be modified. For instance the slot specification rule 

from=Sx.ciry makes reference to the variable x., and thus needs to be modified. The 
5 slot specification rule "city==$x.city" is examined. Because it returns a slot of type city, the slot 
specification rule is converted to "from=$X 1 .city". If there had been no reference to the slot 
"city", the type manager would have been examined and an appropriate type defined. For 
instance if a reference was made to a "from" slot, and the rule did not define a "from" slot, the 
type manager would be referred to. The type of the "from" slot would be defined as "city", and 
1 0 the first slot associated with the type "city" would be used. In this case this would be the slot 
"city". 



Tins would be repealed for all slot definition rules in the slot specification rules 
defined in the rule being substituted into. 



15 



The slot specification rules in the rule being substituted into are then checked for static 
slot specification rules. A static sloi specification rule is one where the slot is explicitly 
defined such as note=tellfrom 

20 If slot specification rules of the rule being substituted into are then checked one at a 

time for static rules that exist in the rule being referenced. In this example the specification 
rule "note=teIlfrom" is located in both sets of rules, and thus the reference to note-tell from in 
the rule being substituted into is replaced by note=$X I .note. 

25 Al the end of lh e process these two rules would be as follows. 

S -> I want to fly XI :XI to CITY:y (1,1) { note=$Xl .note from=SXl .city to=$y.city 



XI -> from CITY:x (1,1) { city=$x.city note=tellfrom } 
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The model merging process 50 can also operate when there is no starting grammar. 
When this is the case the observations are added to the grammar verbatim for instance the 
observation "buy three hundred shares ol abador gold for three dollars fifty a share" observed 
in the state "TopLeveiStock" with the slots { operationally, stockname="abador gold " 
price. dollars=0 price. cents^O price. modifer=per_share } would result in the following rule 
being added to the grammar. 

. TopLeveiStock buy chree hundred shares of abador gold for three 
dollars fifty a share {1,1) ( operation-buy, stockname="abador gold " 
price . do liar s= 3 price . cent s=0 price . modi fe r=per_sha re ) 

During the chunking phase 52 repeated sequences of words, i.e. phrases, in the 
grammar that appear in more than one rule are placed by a reference to a new rule which 
contains the repeated phrase. For instance prior to the chunking phase the rules for two non- 
terminals may be as follows: 

A -> o c d e 
B -> ;■: c d k 

After the chunking phase 52 three rules may be defined as follows: 

A -> b C e 
B -> :•: C \: 
C ~> c d 

This can be expressed as the new rule C -> c d being substituted into the rule A -> b 

c d e. 

The chunking phase also needs to attach slot specification rules to the new phrases. 
Likewise when a production rule is substituted into another production rule, the slot 
specification rules of the new production rule is substituted into the slot specification rules of 
the production rule that references it. 

For instance prior to the chunking phase the rules for two non-terminals may be: 

.TopLeveiStock -> buy Number :xl of StockName : x2 for Money: x3 a 
share (1,1) opera ti.on=buy , s tockname=$>:2 .stockname 
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pr ice. dollars=$x3. price. dollars price . cent s = $x3 . price . cent s 
price . modi fer^pe r_s ha re 

.WaitAskbuyprice -> Money:xl a share (1,1) opera t ion=buyprice 
price. dollars=$xl . price . dollars price . cencs=$xl . price . cents 
price . modi fer=per_sha re 

After the chunking phase 52 three rules may be defined as follows: 

. TopLevelStock -> buy Number::-:! of StockName:x2 for Money:x3 Xl:x4 
(1,1) operat ion^buy, s tockname-$x2 . s tockname 
pr ice. rioliars=$x3. price. dollars price . cent s=$x 3 . price . cents 
price . modi f er=$x4 . price . modi fer 

.WaitAskbuyprice -> Money: xl Xl:x2 (1,1) opera tion«buyprice 
price .dollars = $xl . price . dollars price . cents-*?:-:! . price . cents 
price, modi £ er=-$ :< 2 . pri ce . modi fer 

XI -> a share ( 2 , 2 ) price . modi fer =per share 

In this case the slot specification rule "price. mod ifer=per_share" is substituted into the 

slot specification, 

opera t ion = buy , stockname=$x2 . stock name 
price . dcliars=$x3 . price . dollars price . cent: s = $x3 . price . cents 
price . modi f er=per_sha re 

The result of this is 

opera tion=buy, s tockname =$ x 2 . s tockname 
price . dollars-$x3 . price . dollars price . cent s = $.x 3 . price . cent s 
price . modif er=$x4 .price . modi fer 

The merging phase 54 is able to merge symbols which can be considered to be 
equivalent. The symbols may be terminal or non-terminal. For example, if A and B are 
assumed to be same in the following rules, 
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Then after merging A and B into C the grammar would be 

X -> a C b h 
V -> q C h k 
C -> y u i 
C -> Z C y 

The symbols A and B can be merged into symbol C when the phrases are identified by 
merging evidence patterns, discussed below, as being interchangeable. 

Merging reduces the complexity of a grammar and generalises the grammar so that it 
can handle additional phrases. For instance consider the following fragment of a grammar, 
S -> fromXI.xl (1,1) from=$xi.from 
S -> to X 1 : x 1 (LI) to=Sx!.from 
S -> from X2:xl (1,1) from=$x 1 .from 
XI -> melbourne (1,1) from=meibourne 
X2 -> Sydney (1,1) from=sydney 

In this example the symbols X! and X2 are merged into symbol X3. Creating the 
following grammar. 

S -> from X3:xl (2,1) from=$x 1 .from 
S->toX3:xl (1,1) to=$xl. from 
X3 -> melbourne (1,1) from=rnelbourne 
X3 -> Sydney (1,1) from=sydney 

This new grammar can generate the observation "to Sydney" with the meaning 
to=sydney which the starting grammar could not. 

The chunking process 52 does not generalise the grammar, but may create a new non- 
terminal that adds to the hierarchical structure of the grammar. 



WO 00/78022 



PCT/AUOO/00651 



10 



-20 



The reestimation phase 302 uses statistical techniques to remove ambiguity, and to remove 
redundant rules. 

For instance consider the observations 

Observation 1.) From melbourne to melbourne (1) { from=melbourne to=melbourne} 
Observation 2.) From melbourne to perth (!){from=melbourne, to=perth} 
Observation 3.) From perth to melbourne (l)'from=perth to=melbourne} 

After the chunking, and merging phases the result may be the following grammar. 
Rule 1.) S -> from XI :xl to X 1 :x2 (U){ lrom=Sxl.to to=Sxl.to} 
Rule2.)S-> fromXFxl to Xl:x2 (2.1) { from-Sxl.to to=Sx2.to} 
Rule 3.) XI -> melbourne (4,2) |to=melbourne} 
Rule 4.) XI -> perth (2,2) { lo=perth } 



In this example there are two numbers in brackets prior to the slot specification rules. 
I 5 The first number represents the number of obse.vatio.is that use this rule. The second number 
represents the number of rules that reference this rule. The reestimation phase ^estimates the 
first number so that there are less rules. 

Each observation in the training set is parsed by the grammar. Where more than one 
20 parse is possible, the parse with the highest probability that gives the correct meaning is 
considered to the correct parse. This is known as the Viterbi parse. If there are an equal 
number of possible parses, the observation is considered to be equally parsed by all of them. 

Consider the following observation, 
25 from melbourne to melbourne { from=melboume to=melbourne} 

It can be parsed using rules 1 , 3 & 3. This would give the parse tree 
( S from (XI melbourne) to (XI melbourne)) with the slots { from=melbourne 
to=melbourne}and with probability 1/3 * 4/6 * 4/6 = 0.148 
30 or it may be parsed using rules 2, 3 & 3. This would give the parse tree 
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( S from (XI melbourne) to (XI melbourne)) with the slots { from=mei bourne 
to=melbourne}and with probability 2/3 * 4/6 * 4/6 - 0.296 

Both give the same outcome but it is more likely that rules 2 & 3 are used and thus for 
the purposes of reestimation this does not use rule 1. 

Observations 2 can only be parsed using the second rule as follows. 

(S from (XI melbourne) to (XI perth)) { from=me!bourne, to=perth} using rules 2, 3 

&4 

An alternative parse using rules 1,3 & 4 

(S from (XI melbourne) to (XI perth)) would attach the slots { fro m=me J bourne 
to=melbourne} which is incorrect because it contradicts the training data. 

For the same reasons the third observation can only be parsed-correctly using rules 2 : 
4 & 3. Giving the parse tree. 

(S from (XI perth) to (XI melbourne)) {from^perth to-melbourne } using rules 2,4 & 

j> 

The hyperparameters are then re-estimated using the Viterbi parse. This is done one 
observation at a time. The hyperparameter of each rule is set to zero for most rules, and set to 
1 for fixed rules. In the example above the hyperparameters would initially be set to 
Rule 1.) S -> from XI :xl to XI :x2 (0,1 ){ from=$xI.to to=$xl.to} 
Rule2.)S-> fromXl:xl toXl:x2 (0,1) { from=$x 1 .to to=$x2.to} 
Rule 3.) XI -> melbourne (0,2) {to=melbourne} ' 
Rule 4.) XI -> perth (0,2) { to=perth } 

Using the Viterbi parse the rules are then incremented by the observation count. After 
considering observation I the grammar would become 

Rule 1.) S -> from Xl:xl to Xl:x2 (0,1 ){ from=Sxl.to to=$xl.to} 
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RuIe2.)S->fromXl:xl to XI :x2 (1,1) { from=$xl.to to=$x2.to} 
Rule 3.) XI -> melbourne (2,2) {to=melbourne} 
Rule 4.) XI -> perth (0,2) { to=perth } 

5 After considering observation 2 the grammar would become 

Rule I.) S -> from Xl:xl to Xl:x2 (0,1){ from=$xl.io to=$xl.to} 
Rule 2.) S -> from Xl:xl toXl:x2 (2,1) | from=$xl.to to=Sx2.to} 
Rule 3.) XI -> melbourne (3,2) {to=melboume} 
Rule 4.) XI -> perth (1,2) { to-perth } 

10 

After considering observation 3 the grammar would become 
Rule 1.) S -> from Xl:xl to Xl:x2 (0,1 ){ from=$x!.to to=$xl.to} 
Rule 2.) S -> from X 1 :x 1 to X 1 :x2 (3,1) { from-Sx 1 .to to=Sx2.to > 
Rule 3.) XI -> melbourne (4,2) {to=melbourne} 
15 Rule 4.) XI -> perth (2,2) { to=perth } 

Rules that have a hyperparameter of zero would then be deleted. After reestimation the 
resulting grammar would be: 

Rule 1.) S -> from Xl:xl to Xl:x2 (3,1) { from=Sxl.to to=Sx2.to} 
20 Rule 2.) XI -> melbourne (4 : 2) {to=melboume} 

Rule 3.) XI -> perth (2,2) { to=perth } 

The reestimation phase executes a variation of the grammatical inference inside- 
outside algorithm, and is used to remove ambiguity and to delete unnecessary rules. 

25 

The model merging process 50 is able to operate on a list of rules, such as the rules of 
the predefined grammar 24 and rules which represent observations. A rule is assigned a 
probability of occurring which can be calculated from the probabilities of the observations. 
These probabilities can be estimated by counting the number of times the observation has 
30 occurred and dividing by the total number of observations. The merging process 50 does not 
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create or use cost functions, which have been used by some grammatical inference engines to 
decide steps to be executed and when execution should cease. 

Rules are stored using a double linked list format where each symbol has pointers to 
the preceding and succeeding symbol. The format enables long rules to be shortened and 
lengthened without computationally expensive replication of data, and a sequence of symbols 
can be moved from one rule to another by changing the pointers at either end. without 
modifying data in between. 

To meet principle (1) of the merging process during the incorporation and chunking 
phases, two data structures are created. The first is a Monogram table and the second is a 
bigram table. The monogram table has an entry for even' word type in the grammar, for 
instance the word melbourne. This entry has a pointer to every occurrence of this word in the 
grammar, plus a set of attribute constraints. The bigram table has an entry- for even,' occurrence 
of two successive symbols. For instance "to melbourne" or "to XI". It also has a pointer to 
every occurrence of this bigram in the grammar, plus a set of attribute constraints, plus a set 
of slot specification rules. 

New rules are created during the chunking phase by first examining the monogram 
table and then the bigram table. 

The monogram table is sorted so that the first monogram to be pulled of it has the most 
number of non fixed rules. If there are two candidates with the same number of non-fixed 
rules, the one with the least number of attribute constraints is chosen. A new rule is then 
created with an unique symbol on its left hand side and the symbol on its right hand side. The 
hyperparameter of the new rule is set to the number of observations, while a reference count 
is set to one. The attribute constraints attached to the monogram are then converted to a slot 
specification rule. . 
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All instances of this word in the grammar are then be substituted by the new non- 
terminal. The slot specification rules are then modified to derive slot values from the newly 
formed rule. This is achieved by substituting the attributes to=Tnelbourne from the newly 
created rule into the existing slot specification rules using the slot specification substitution 
5 process. For instance two rules may exist as follows: 

S -> to melbourne (1 ,1 ).{to=melboume) 

S -> from melbourne (1,1) {from=melbourne} 

A new rule is then created as follows: 
10 XI -> melbourne (22) {to=melbournej 

All instances of "melbourne" are then replaced by the non-terminal XI as follows: 

S -> to XI (1,1) {to=melboume} 

S -> from XI (1,1) {from=melbourne} 

15 

The bigram table and monogram table are updated as this occurs. The slot specification 
rules are then modified., by attempting to substitute the to=melbourne returned by XI into the 
slot specification rules attached to rule S. The resulting rules would become. 

S-> toXl:xl (1,1) {to=$xl.to} 
20 S->fromXl:xl (1,1) {from=$xLto} 

XI -> melbourne (2,2) {to=melbourne} 

To accommodate prepositional phrases, a slot definition file is generated that assigns 
types to the slots to enable modification of slot specification rules. This file defines the slot 
25 name and its type. An example may be: 
location 
to location 
from location 
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Once there are no more rules that can be created using the monogram table, the bigram 
table is examined to create new rules. The bigram table is sorted so that the first bigram to be 
pulled of it will have the most number of occurrences, and the least number of attribute 
constraints, and doesn't hide any other begrimes. In addition to storing attribute constraints for 
each entry in the bigram table, slot specification rules are also be stored. Whenever one of the 
symbols in the bigram is referenced for the purposes of slot specification, these fragments of 
slot specification rules are stored in the bigram table. If two "different slot specification rules 
are used in separate production rules, that conflict the bigram is never chinked. 

A new rule is then created with an unique symbol on its left hand side and the two 
symbols of the bigram on its right hand side. The slot specification rules attached to the bigram 
are added to the newly formed Rile. In addition the attribute constraints attached to the bigram 
are then converted to a slot specification rules and attached to the newly formed rule where 
this does not conflict with the slot specification rules. 

All instances of this bigram in the grammar are then be substituted by the new non- 
terminal. The slot specification rules are modified to derive slot values from the newly formed 
rule. This is achieved by substituting the attributes from the newly created rule into the 
existing slot specification rules. For instance two rules may exist as follows: 

S -> to Xl:xl (1,1) {to=$xl.to} 

S -> from X 1 :x 1 to X 1 :x2 ( 1 , 1 ) { from=$x 1 .to to=$x2.to} 

A new rule is then created as follows: 
X2 -> toXl:xl (1,1) {to=$xI.to} 

All instances of M to XI" are then replaced by the non-terminal X2 as follows: 
S-> X2 (1,1) {to=$xl.to} 

S -> from Xl:xl X2 (1,1) {from-$xl.to to=$x2.to} 
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The slot specification rules are then modified, by attempting to substitute the 
to=melbourne returned by XI into the slot specification rules attached to rule S. The resulting 
rules would become 

S-> X2:x2(l,l) {to=$x2.to} 
5 S-> fromXl:xl X2:x2 (1,1) {from=Sxl .to to=$x2.to} 

X2 -> toXl:xl (I,l)'{to=$xl.to) 

Substituting slot specification rules from newly created rules into existing rules is 
achieved using the slot specification substitution procedure which executes the following 
10 steps: 

(1) A function substitute(Attributes substitutejnto. Attribute substitute_from ; 
Symbol newjsymboL Symbol first_symbol, Symbol ■ second_symbol) is called. 

(2) In this function ail references to the bigram symbols (first_syrnbol and 
second_symbol) in the "substitmejnto" set of attributes are replaced by 

1 5 references to the new_symbol. The slot referenced on the right hand side of the 

individual slot specification rule is then assigned. If the slot exists in the new 
rule : it is assigned to that. If ii is not defined in the newly created rule, it is 
assigned to the first slot of that type listed in the slot definition file. 

(3) If the newly created rule defines a static slot value (x=y rather than x=$y.z) and 
20 an identical static slot value exists in the rule being substituted into a reference 

is made from the slot specification rule to the slot returned by the newly 
created rule. 

To meet principle (2) a reference count is attached to each rule which contains the 
25 number of other rules that reference the rule, and the reference count is distinct from the 
hyperparameter. When a rule refers another rule, the reference count on the other rule is 
incremented. When a rule ceases to use another rule, the reference count on the other rule is 
decremented. When the reference count for a rule becomes zero, the symbols contained in that 
rule are placed back in the rule which previously referred to or referenced the rule that now 
30 has a reference count of zero. 
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Although the monogram list and the bigram lists make reference to n-grams of length 
1 and 2 respectively, rules of arbitrary length can be created, by merging rules that are only 
referenced by one other rule into that rule. 

Operation of the chunking procedure is illustrated with reference to the following 

example, where the observations are: 

i like coffee in zhe morning (10) opera t ion=update_knowledge 
drink=cof f ee 

i like tea in zhe morning (20) opera tion=upda t acknowledge drink=tea 
i'd like a cup of coffee please fS) opera tion=request_drink 
drink-coffee 

The number at the end ol the observations above is the number of times thai phrase has 
been observed. As defined previously, in the rules below there is a two dimensional vector (i j) 
at the end of the rule. The first element i of the vector is the reference count and the second 
element j of the vector is the hyperparameter. In the scenario where there is no starting 
grammar, and the top level grammar is 'S\ the grammar at the end of the incorporation phase 
would be: 

S -> i like coffee in che morning • 1 0 , i ) . { dr ink=co£ f ee 
opera t ion =update_knowl edge } 

S -> i like tea in the morning (20,1) (drink=cea 
opera c ion = update_know ledge } 

S -> i'd like a cup of coffee please (5,1) { drink=cof fee 
opera t ion = reques t_dr ink } 

In addition the monogram table would be as listed below. In this listing the first 
number after the symbol being referenced, is the number of times that symbol appears in the 
grammar. The second number is the number of non-fixed rules that this symbol appears in. It 
is this second -number that is used to determine which rule should be created first. 

all drink=cof f ee ^=coffee * -reques t_dr ink 
opera c ion= reques t_drm k 

coffee 2 2 drink=coffee *=coffee 
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cup .1 1 drink=cof fee 4 =coffee 4 =request_drink 
opera tion=request_dr ink 

i 2 2 * =update_knowiedge operat ion=upda te_knowledge 

i'd 1 1 drink=coffee *=coffee * =request_drink 
opera tion=request_drink 

in 2 2 ~=update_know.ledge ope ra t ion=upda te_knowledge 

like 3 3 

morning 2 2 * =upda c e_knowledge opera tion=update__knowledge 
of 1 1 drink=cof f ee *=coffee ; =request_drink 
opera tion=request_drink 

please 1 1 drink=coffee -^coffee * =reques t_drink 
ope ra t ion= request _dr ink 

cea 1 1 drink=cea *=cea * =upda te__knowledge 
opera c ion=upda t e_knowledge 

che 2 2 ' =upda t e__ know! edge opera tion=updace_knowledge 
The Digram table would be 

a cup 1 1 dr ink = cof f ee '-coffee 1 - reques t_drin k 
ope ration-request_d rink 

coffee in 1 X drink=corfee ' -coffee * =update_ knowledge 
opera t ion = upda t e_ know! edge 

coffee please 1 I drink=cof fee ■ = c o f f e e • =reques t_dr ink 
operat ion=request_drink 

cup of 1 1 dr i:ik=c:of re-w '-coffee * =reques t_dr ink 
opera tion= reques t_dr ink 

i like 2 2 * = upda te_ know 1 edge ope ra c ion=upda t e_knowledge 

i'd like 1 1 drink^cor t ee 4 =coffee * = reques t_dri nk 
opera ti on= requested rink 

in the 2 2 ; =upda L e_knowiedge operat ion=update_knowledge 

like all drink = c:offee 4 =coffee 4 =reques t_drink 
ope r a t ion = reques t_d r i nk 

like coffee 1 1 drink=coffee 4 =coffee 4 =updat e_knowl edge 
opera tion=update__knowl edge 

like tea 1 1 drink = tea *=tea 4 =upda te__knowledge 
opera tion=update_ knowledge 

of coffee 1 1 drink=coffee 4 =coffee * =reques t_drink 
opera t ion =request_dr ink 

tea in 1 1 drink = tea * = t ea * = upca te_knowledge 
operat ion =upda te_knowledge 

the morning 2 2 4 -upda te_ knowledge 
operat ion =update_ know ledge 
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The chunking phase would then begin. The Monogram table would first be examined. 
Based on the monogram table, the first rule to be created would be 
X21 -> I (30,2) { operation=aipdateJcnowledge } 

The name of the non-terminal pC2 1 ) is assigned arbitrarily. The slot specification rules 
are extracted from the monogram table. The hyperparameter and reference or rule count are 
derived from the rules into which this new rule is substituted. The resulting grammar would 

be. 

Step I . The rules are: 

S -> K21:X21 like coffee in the morning (10,1) ( drink-coffee 
opera L i o n — $ X 2 1 . opera t ion } 

S X2i:X21 like tea in Che morning (20,1) { drink-tea 
ope ra c icn=$X2 I . ope ra Lion } 

S -> i'd like a cup c'f coffee please {5,1} { drink=coffee 
ope ration=request_crinfc } 

X21 -> i. (30,2) { operacioi --upda ue_knowledge } 

After this has occurred the monogram tabic becomes (the following steps 1 to step 1 1 are a 
continuation of this process): 

X21 2 2 *-=updace_knowiedge opera t ion=update_knowledge 

all drink=coffee "-coffee '=request_drink 
operation=request_drink 

coffee 2 2 drink^coffee *=coffee 

cup 1 1 drink=coffee 4 =coffee A =reques t_drin k 
opera tion=reques t_drink 

ill * =update_knowledge operat ion=update_knowledge 

i'd 1 i drink=coffee + =coffee 4 =request_drink 
operation=request_drink 

in 2 2 *=update_knowledge opera tion=update_knowledge 
like 3 3 

morning 2 2 * =upda c e__knowl edge opera t: ion^upda t e_knowl edge 
of 1 1 drink-coffee '-coffee 4 =request_dr ink 
operacion=reques c drink 
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please 1 1 drink-coffee '-coffee *=request_drink 
opera t ion=request_dr ink 

tea 1 1 . drink-cea k =tea * =update_knowledge 
opera c ion=upda te_knowl edge 
5 the 2 2 *=update_knowledge operation-up'da te_knowledge 

Step 2 

S -;• X21:X21 Uke X23:X23 in che morning (10,1) { drink-$X23 - drink 
opera tion=$X2 1 . opera Lion } 

5 "> X21:X21 like tea in the morning (20,1) { drink=tea 
opera t ion =5X2 1 . opera t ion } 

S -> i'd like a cup of X23:X23 please (5,1) ( drink=SX23 . drink 
ope r a c i on = r eque s c d r i n k } 

X 21 - s i ( 30 , 2 ) ( ope rati on = upda t e_knowledge } 
5 X23 -> coffee (15,2) > drink=coffee } 

x2i *- - * =update_knowiedce opera t ion^upda te_knowledge 
X23 2 2 drink=cof f ee *=coffee 
a i } drink-coffee "-coffee ' = reques e_drin k 
opera z ion~ reques c_dr m k 
) coffee I 1 drmk-cof f ee * = c o f f e e 

cup 1 I drink-coffee 4 -coffee 1 -reques t_drink 
ope r a t :on *= reques c drink 

- 1 1 ; = updat:e_knowiedge opera c ion=update_knowledge 
i'd 1 1 rir mk=co f f ee ; -coffee '-request drink 
opera c ion™ reques t_dr in k 

in 2 2 A =upriace_ knowledge ope rati on=update_knowledge 
like 3 3 

morning 2 2 • =upda te_knowledge opera tion-upda t e_knowledge 
. of 1 1 drink=coffee '-coffee '-request drink 
opera tion=request_dr ink 

please 1 1 drink-coffee --coffee * -request_drink 
opera t ion=requ est _drink 

tea 1 1 drink-tea i= tea * =upda te_knowledge 
opera tion=update_know ledge 

the 2 2 *-update_knowiedge opera tion=upda te_knowledge 



Step 3 

S -> X21:X21 like X23:X23 X2-S:X24 the morning (10,1) ( drink-$X23 . drink 
opera tion-$X2 1 . operation } 
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S -> X21:X21 like tea X24:X24 the morning (20,1) { drink=tea 
opera tion=$X21 . operation } 

5 -> i'd like a cup of X23:X23 please (5,1) (' drink=$X23 . drink 
operac ion = request _dr ink ) 

X21 -> i (30,2) ( operat.ion=update_knowledge } 

X23 -> coffee (15,2) { drink=coffee } 

X24 -> in (30,2) I operacion=upda te_knowledge ) 

2 2 * =update_knowledge ope rat ion=updat e_knowledge 

X2 3 2 2 drink=cof fee ^coffee 

>:2 ' i 2 2 * =update_knowledge opera tion=updat e_know ledge 
a 1 1 drink«=cof f ee * =cof fee * =reques t_drink 

ope rat i o n = r eq ue s c _crr i n k 

coffee 1 1 drink^coffee *=cof fee 

cup I i dri.nk=cof fee : =co free '^request drink 

ope ra c i on = request drink 

i 1 * * =update knowledge opera tion=update_knowledqe 
i-'d 1 1 dr ink =co free : =coffee '^request drink 

opera c i or. = request drink 

' n ' l 1 1 ='Jpdate_ knowledge opera t ion=upda te_knowledge 

like 3 ?• 

morning 2 2 4 =upd3 te__knowiedge opera tion=upda te_knowledge 

of I 1 drmk=cof fee -=coffee ' = reques t_dr ink 
ope ra l i on= reques c d r i n k 

please i 1 drink=coffee ' =co f fee -=request drink 
opera i: ion=reques c_drink 

re a i .1 drink = cea 4 =tea * =upda c e__ knowledge 
opera z icn=upda ce_ knowledge 

the 2 2 1 =update_knowledge ope ra t ion=upda te_knowledge 

Step 4 

S -> X21:X2i like X23:X23 X24:X24 X25:X25 morning (10,1) { 
drink=$X2 3 . drink opera t ion=$X 21 . opera t ion } 

S -> X21:X21 like cea X24:X24 X25.X25 morning (20,1) ( drink=tea 
operation=$X21 . operation } 

S -> i'd like a cup of X23:X23 please (5,1) { drink=$X23 . drink 
operat ion = requesc_drmk ) 

X2! - > i (30,2) ( operat ion=update knowledge f 
X23 -> coffee (15,2) { drink^coffee } 
X24 -> in (30,2) \ opera t ion=upda te_knowledqe } 
X2 5 -> the (30 2 J i opera t ion =upda te_ knowledge } 
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Slots are 

X2I 2 2 ■ =update_knowledge opera t ion=upd'ate_knowledge 
X23 2 2 drink=corfee *=coffee. 

X24 2 2 *=update_knowledge operat ion=update_knowledge 
5 X25 2 2 >=update_knowledge operat ion=update_knowledge 

a 1 1. drink=cof fee -^coffee 4 =request_drink 
ope raciGn=request_drink 

coffee 1 1 drink=cof fee *=coffee 
cup 1 1 drink=corfee '^coffee '^request drink 
10 cpe c a z i c n = r eque s c _d rink 

;, ". 1 ■ =updace_knov:iedge cpe ra t ion=upda te_knowl edge 
i'd i 1 dr ink=cof fee *=cof fee - =request_dri n k 
ope ra c i cn= reques _c!r i n k 

in 1 .1 ■ -upda ue_ Knowledge opera t ion=updace knowledge 
15 like 3 3 

morning 2 2 * -=upda te_ Knowledge opera tion=update__knowledge 
of : 1 cinnk=r-c['tee '-coffee ; =reques t_drink 
ope ra c io:.- reques civ in k 

please I i. :i l k^eo i : f ee '=coffee 4 = reques t_drink 
20 opera cior. = r eque zz_z:c ink 

= c i 1 drink-tea ' - tea "=update knowledge 
o p e racio r. = u pda c e _ k now 1 e d g e 

tJie-j 1 • ---upca te_k now! edge opera tion=update_knowIedge 

25 .Siep 5 

5 -> X21:X21 like X23:X23 X24:X24 X25:X25 X26:X26 10,1) { 
dr ink=SX23 . drink opera t ion=$X2 1 . operation } 

3 -> X22:X21 like tea X24:X2* X25:X25 X26:X26 20,1) { drink=tea 
opera tion = $X2 3 . opera t ion } 
30 S -> i'd like a cup of X23:X23 please (5,1) { drink=$X23 . drink 
opera t ion = reques t_dr ink } 

X21 -> i (30,2) { operation=update_knowledge } 
X23 -> coffee (15,2) { drink=coffee } 
X24 -> in (30,2) ( opera t i on=upda te_knowledge } 
35 X25 -> the (30 2 ) ( opera t ion=upda te_knowledge } 

X26 -> morning (30,2) { ope ra t io.n-upda t acknowledge } 

2 2 ; -upda L ^knowledge opera t ion=upda te_knowledge 
X23 2 2 drink=cof nee • =cof fee 

4 2 2 ■ =upda te_knowiedge operat ion=upda te_knowledge 
40 X25 2 2 ' =upda te_knowledge operat ion=update_knowledge 
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10 



15 



20 



35 



X26 2 2 * =update_knowledge opera t ion=upda te^knowledge 
a 1 1 drink=coffee '-coffee - =request_drink 

opera tion=request_dr ink 

coffee 1 .1 drink=coffee ^coffee 

cup 1 1 drink=coffee *=coffee ' =request_drink 

opera tion=request_dr ink 

i I 1 J =update_knowledge opera t ion=update_knowiedge 
i'd 1 1 drink=coffee *=coffee ' =reques t_drink 

opera cion = reques c__dr ink 

in 1 .1 ^updace knowledge opera c ion=updat e_knowl edge 
like 3 3 

morning 1 .1 ' =upda re_ knowledge opera t ion=upda te_knowledge 

of i 1 drink=cof fee *=cof£ee : =reques c_dr ink 
ope r a c i on = reques c dr i n k 

please 1 1 drink=cof fee ^coffee *=request_drink 
operation* \: equ e s t _d r i n k 

tea 1 1 diink-uea *=cea i =updace_knowledge 
opera t ion=upda t;e_-:nowl edge 

che i I * = update_ knowledge opera eion=update_knowledge 



Step 6 

S X21 :X21 like X22:X2 3 X24:X24 X25:X2S X26:X26 10,1) { 
cnnk«$X23 . dr ink cpera u ion*=$X2 1 . operation ) 

S -> X21:X2.! like X27:X27 X24:X24 X2b:X25 X26:X2S 20,1) { 
25 arm k - $X 27 . dr i n k opera t ion = $X2 1 . ope r a c i on ) 

S -> i'd like a cup of X23:X23 please (5,1) { dr in k=$X23 . drink 
ope ration= request drink } 



30 



40 



X21 


-> i (30,2) { operacion=update knowledge ) 




X2 3 


-> coffee 


(15,2) ( drink=coffee } 




X24 


-> in (30, 


2) ( operation=upda te knowledge } 




X25 


-> che (30 


2 ) ( operation=update_knowledge } 




X26 


-> morning 


(30,2) { operat ion=upda te knowledge } 




X27 


-> tea (20,1) { drink=tea opera tion=update knowledge } 




X21 2 2 


*=update_knowledge opera t ion=upda te 


knowledge 




X23 2 2 


drink=coffee ^coffee 






X24 2 2 


* = update_know.Ledge operation-update 


knowledge 




X 2 5 2 2 


' *update_knowledge ope rat ion=upda te 


knowl edge 




X 2 6 2 2 


' =update_knowledqe ope ra t ion=upda te 


knowledge 




X27 I ] 


drink-tea ; =tea '-update knowledge 





opera t ion-upda t e_know 1 edge 
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all drink=coffee ^coffee ; =request drink 

opera tion= request _dr ink 

coffee 1 1 drink^coffee *=coffee 

cup 1 1 drink=coffee *=coffee * =request_drink 

opera tion=reques t_drink 

i 1 1 i= update_knowledge opera t ion=update_knowledge 
i'd 1 1 drink-coffee l =coffee -^request drink 

opera t ion = reques t__drin k 

in 1 1 4 =updat acknowledge opera t ion=updat acknowledge 
like 3 3 

morning 1 1 ; =upda ce_knowledge opera t ion=updace_knowledge 

of 1 1 drink-coffee ; =coffee ; =reques t_drink 
operation — request drink 

please 1 1 drink=cof f ee *=coffee ^request drink 
operat ion=request_drink 

tea 1 I drink-tea *=tea * =updace_knowledge 
o o e r a ' i o n = u pd a t e know i e d c e 

the 1 I ■ 4 =update_knowlerige ope rat ion=upda te_knowiedge 

Step 7 

S -> X21:X21 like X23:X23 X2 4 :X24 X25:X25 X26:X26 1.0,1) { 
cr i n k = $X 2 3 . dr i n k ope r a z ion=$X2 1 . opera Lion} 

S -> X21:X21 like X27:X27 X24:X24 X25:X25 X26:X26 20,1) { 
drir.k = $X27 . drink opera t ion = SX2 1 . operation } 

5 -> X28:X28 like a cup of X23:X23 please (5,1) { drink=$X23 . drink 
opera tion=$X2 8 . operation ) 

X21 -> i (30,2) { operat ion*=update_knowledge ) 

X23 -> coffee (15,2) { drink=cof f ee ' } 

X2<1 -> in (30,2) { opera t ion=updat e_ knowledge } 

X25 -> the (30 2 ){ opera tion=upda ce_knowledge } 

X26 -> morning (30,2) 1 opera tion=update_knowledge } 

X27 -> tea (20/1) { drink=tea operat ion=update_knowledge } 

X28 -> i'd (5,1) { drink=coffee operation=request_drink } 

X21 2 2 -*=update_knowledge operat ion=upda te_knowledge 

X23 2 2 drink=coffee *=coffee 

X24 2 2 A =update_knowledge opera tion=update_knowledge 
X25 2 2 1 =update_knowledge operat ion=update_knowledge 
X26 2 2 *=update_knowledge operation=update knowledge 
X27 1 l drink-tea -=tea * =upda te_knowledge 
opera tion=upda te_k now ledge 
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X28 1 1 drink=coffee ^coffee * =request_drink 
opera tion=request_dr ink 

all drink=coffee ^coffee * = reques t_drink 
ope ration=request_d rink 
5 coffee 1 1 drink=coffee '=coffee 

cup 1 1 drink^coffee ^coffee -=reques t_drink 
operat ion= reques t_dr ink 

ill i =update_knowiedge operat ion=update__knowledge 

i'd 1 1 drink^cof fee '^coffee * =reques t_drink 
10 oper at ion= reques t_dr ink 

in 1 1 -=upda te_knowledge opera t ion=upda te_knowledge 

like 3 3 

morning 1 1 A =upda t e_knowiedqe ope ra c ion=upda t e_knowledge 
of 1 1 drink=coffee ' =co f fee •= reques t_cir ink 
15 opera t i on =request_d rink 

please .1 1 drink=coffee *=coffee reques c_drink 
opera t ion = reques t_dr ink 

tea 1 1 drink=tea *^i:ea ; =upda t:e__knowledge 
opera t icn = upda t e_knowl edge 
20 the 1 i * =upda te_knowledge opera t ion=upda z e_knowledge 



Step 8 

S -> X2l:X2l like X23:X23 X24:X24 X25:X25 X26:X26 10,1) { 
drink = $X2 3 . drink opera t ion = $X2 1 . ope ran ion ) 
25 S -> X21:X21 like X27:X27 X24:X24 X25:X25 X26:X26 20,1) { 
drink=$X27 .drink opera t ion = $X2 1 . opera t ion } 

S -> X28:X28 like X29:X29 cup of X23:X23 please (5,1) { drink=$X23 . drink 
opera t ion = $X2 8 . opera t ion } 

X21 -> i (30,2) { operation=update_knowledge } 
0 X23 -> coffee (15,2) { drink=coffee } 

X24 -> in (30,2) { opera t ion=upda te_knowledge } 

X25 -> the (30 2 ){ operat ion=update_knowledge } 

X26 -> morning (30,2) ( operat ion=upda te_knowledge } 

X27 -> tea (20,1) { drink=tea opera t ion=update_knowledge } 
5 X28 -> i'd (5,1) { drink=cof fee opera t ion=request_drink } 

X29 -> a (5,1) ( drink=coffee opera tion=request_dr ink } 

Slots 

X21 2 2 * =upda te^knowledge opera tion=upda te__knowledge 
X23 2 2 drink=coffee *=coffee 
0 X24 2 2 *=update_knowledge ope ra t ion=upda te_knowledge 
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X25 2 2 *=update_knowledge operat ion=update_knowledge 
X26 2 2 1 -update_knowledge ope ra tion-upda t e_knowledge 
X27 1 1 drink-tea *-tea * -upda te^knowledge 
operat ion -upda te_knowledge 

X28 1 1 drink-coffee '-coffee ' -reques t_drin k 
opera tion=reque st _drink 

X29 1 1 drink=coffee '-coffee ^requestjinnk 
operat ion=request_dr ink 

all drink-coffee '-coffee ' -request_drink 
operat ion^reques t_drink 

coffee 1 1 drink-coffee cot fee 
cup 1 1 drink-coffee '-coffee '-request drink 
operat ion=request_drink 

ill *=update_knowledge opera t ion-upda t;e_knowl edge 
i'd 1 1 drink-coffee '-coffee '-reauesc drink- 
ope rat ion=request_dr ink 

in 1 J- * =upda te_knowiedce operdlion = updace knowledge 
like 3 3 

morning 1 1 * =update_knowiedge ope r a t ion=upua t acknowledge 

of 1 1 drink-coffee * =co f fee ' =request_ drink 
operat ion = request__drink 

please 1 1 drink-coffee --coffee ' -reques t_drink 
operation- r e que s t _d rink 

tea 1 1 dr ink-tea '-tea * -update knowledge 
opera t ion-upda t e_ know ledge 

the 1 1 4 -upda te_knowledge opera t ton-upda te knowledge 

Step 9 

S -> X21:X21 like X23:X23 X24:X24 X25:X25 X26:X26 (10,1) { 
drink=$X23. drink operation -SX21 . operation ) 

S -> X21:X21 like X27:X27 X24:X24 X25:X25 X26:X26 (20,1) { 
drink=$X27 . drink opera t ion-$X2 1 . operation } 

S -> X28:X28 like X29:X29 X30:X30 of X23:X23 please (5,1) { 

drink=$X23. drink operation-$X28. operation ) 

X21 -> i (30,2) { opera t ion-upda t e_knowledge } 

X23 -> coffee (15,2) ( drink-coffee } 

X24 -> in (30,2) { opera tion-upda te_knowledge } 

X25 -> the (30 2 ) ( operat ion-upda te_knowledge } 

X26 -> morning (30,2) { opera t ion-upda te_knowl edge } 

X27 -> tea (20,1) ( drink=cea ope ra t ion-upda te_knowledge ) 
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X28 -> i'd (5,1) { drink=coffee operatlon=reques t_drink. } 
X29 -> a (5,1) { drink=coffee opera tion=request_dr ink } 
X30 -> cup (5,1) { drink=coffee opera tion=requesc_drink } 
all 

5 X21 2 2 * =update_knowledge opera t ion=upda te_knowledge 

X23 2 2 drink=coffee 4 =coffee 

X24 2 2 *=update_knowledge opera tion=update_knowledge 

X25 2 2 *=upda te_knowledge opera t ion=update_knowledge 

X26 2 2 * =upda te_knowiedge ope ra t ion-updat e_knowledge 
10 X27 1 1 drink=tea v = tea * =upda te_knowledge 

ope rat. ion=upda te_ know ledge 

X28 1 I drink=coffee *=coffee 4 =requesc_drink 
opera t ion = request _dr ink 

X29 1 1 drink=coffee * -co tree * =reques t_drink 
15 opera t ion=requesc_drin k 

X30 1 1 drink=cof fee *=coffee * =requesc drink 
opera c:.on = r equest_d rink 

all drink=coffee : =coffee - ^request drink 
opera tion= request _dr ink 
20 coffee 1 1 drink=cof fee '=coffee 

cup 1 1 drink=coffee J =coffee * -reques t drink 
operaiion=reque5t:_drink 

i 1 I * =updat acknowledge opera t ion=updat acknowledge 

i'd 1 1 drink=cof fee *=coffee 4 =reques t_drink 
25 ope r a z. i on = r eque s t __d r i n k 

in 1 1 * =upda t e_knowiedge opera tion=update_knowledge 

like 3 3 

morning 1 1 A =upda t e_knowledge opera tion=update_knowledge 
of 1 1 drink=coffee * =cof f ee • i ' = requesc_drin k 
30 opera tion=request_drink 

please 1 1 drink-coffee ; =coffee ' =request_drink 
opera t ion=request_dr ink 

tea 1 1 drink='tea *=tea * =upda t e_knowledge 
opera tion=update_knowl edge 
35 the 1 1 * =upda te_ knowledge opera t ion-upda te_knowledge 



Step 10 

S -> X21:X21 like X23:X23 X24:X24 X25:X25 X26:X26 10,1) { 
drink=$X2 3 . drink opera t ion=$X2 1 . operation } 
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S -> X21:X21 like X27:X27 X24:X24 X25:X25 X26:X26 20,1) { 
drink=$X27 . drink opera tion=$X2 1 .operation} 

S -> X28:X28 like X29:X29 X30:X30 X31:X31 X23:X23 please (5,1) { 

drink=$X23. drink opera t ion=$X28 . operation } 

X21 -> i (30,2) ( opera tion=update_knowledge ) 

X23 -> coffee (15,2) { drink=coffee } 

X24 -> in (30,2) ( operat ion=upda te_knowledge } 

X25 -> the (30 2 ) { operat ion=update_knowledge ) 

X26 -> morning (30,2) { operat ion=upda te_knowledge } 

X27 -> tea (20,1) { drink=tea operat ion=update_knowledge } 

X28 -> I'd (5,1) { drink=coffee operat ion=*request_dr ink } 

X29 -> a (5,1) ( drink=cof£ee opera t ion=request_drin k } 

X30 -> cup (5,1) { drink-coffee opera ticn=request_drink } 

X31 -> of (5,1) { drink-cof f ee opera tion=reques t_dr ink } 

Slots 

all 

X21 2 2 * =update_knowledge opera tion=update_knowl edge 

X2 3 2 2 d rink- co f f ee * =cof f ee 

2 2 *=update_knowledge opera t ion = upda ce knowledge >12 4 X25 
2 * =updace_knowiedge ope ration-update knowl edge 

X25 2 2 * =upda t e__knowiedge opera tion=update knowledge 

X26 2 2 ' »upda te_knowledge opera tion=update_knowledge 

X27 I 1 drink=cea *=cea ; = upda t e_knowl edge 
opera t ion =updace_knowl edge 

X28 1 1 drink=coffee ; =co£fee '^request drink 
opera t ion=request_dr in k 

X29 1 1 drink=coffee ^coffee * =reques t_drink 
opera tion=reques t_drink 

X30 1 1 drink=coffee *=coffee * =request_drink 
operation=request_drink 

X31 1 1 drink=coffee 4 =coffee 4 =reques t_drink 
operat ion = requester ink 

a 1 .1 drink=coffee *=coffee * =reques t_dr ink 
opera tion=request_drink 

coffee 1 1 drink=coffee + =coffee 

cup 1 1 drink-coffee 4 =coffee * =reques t_drink 
opera t ion = reques t_dr ink 

i 1 1 * =update_knowledge operat ion=update_knowledge 

i'd 1 1 drink=coffee *=coffee 1 =reques t_drink 
cperation=request_drink 

in 1 1 * =upda te__knowledge ope ra t ion-updat: e_knowledge 
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like 3 3 

morning 1 1 '* =upda te_knowiedge opera tion=upda te_knowledge 

of 1 1 drink=coffee + =coffee ' =reques t_dr ink 
operation=request_drink 
5 please 1 1 drink=coffee *=coffee * =reques t_drink 

opera tion=request_d rink 

tea 1 1 drink=tea 4 -tea * =update_knowledge 
opera tion=update_knowl edge 

the 1 1 * =update_knowledge opera t ion=update_knowledge 

10 

Step I 1 

S -> X21:X21 like X23:X23 X24:X24 X25:X25 X26:X26 10,1) I 
drink=SX2 3 . drink opera tion=$X21 . operation } 

S -> X21:X21 like X27:X27 X24:X24 X25:X25 X26:X26 20,1) { 
15 drink=SX27 . drink operation=$X21 •. operation } 

S - > X 2 8 * X ^ 8 1 ' V e X 9 • X 2 9 X 3 0 • '"• 30 X ~* X * X 31 v ~ ^ 3 * X 2 3 •*" 3 2 * X 3 ^ 5 1 J ■ { 
drink-$X2 3 . drink opera t ion=$X2S . operation } 
X21 -> i (30,2) { opera tion=update_knowledge } 
X23 -> coffee (15,2) ( drink=cof £ ee } 
20 X24 -> in (30,2) ( operac ion = updat e__knowledge } 
X25 the (30 2 ){ opera t ion=upda t e_knowl edge } 
X26 -> morning (30,2) { opera t ion=upda te_knowledge ) 
X27 -> tea (20,1) { drink=.tea operat ion-upda te_knowiedge • 
X28 ->*i'd (5,1) ( drink=cof fee opera tion=request_dr ink } 
25 X29 -> a (5,1) { dr in k=cof f ee opera t ion-request _drink ) 

X30 -> cup (5,1) I drink=coffee operat ion=reques t_drink } 
X31 -> of (5,1) { dr ink=cof f ee opera t ion-reques t_dr ink } 
X32 -> please (5,1) ( drink=coffee operat ion=reques t_dr ink } 

This would then complete all of the chunking that is suggested from the monogram 

table. At this point the bigram table would look as follows: 

X21 like 2 2 * =updat e_knowledge opera tion=upda te_knowl edge 
operation=$l .operation 

X23 X24 1 1 drink^coffee i= coffee *=update__knowledge 
opera tion=update_knowledge drink=$ 1 . drin k 

X2-3 X32 1 1 drink=coffee *=coffee * = request_drink 
opera t ion= requester ink drink = $l. drink 

X24 X25 2 2 * =upda t e_knowledge opera tion = update__knowiedge 



30 



35 
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X25 X26 2 2 * =upda te^knowledge operat ion=update_knowledge 

X27 X24 1 1 drink=tea ^tea * =upda te_knowledge 
opera tion=update_knowledge drink=$l .drink 
5 X28 like 1 1 drink=cotfee ^coffee *=request_drink 

opera t icn= requested r ink ope ration=S 1 . operation 

X29 X30 1 1 drink=coffee ^coffee ' =requesc_drink 
opera tion= request _drink 

X30 X31 1 1 drink=cof f ee '=cof fee ' =reques t_drink 
10 ope rac ion=request_drink 

X31 X23 1 1 drink=coffee '^coffee "* -reques c_dr ink 
operation=request_drink drink=$2 . drink 

like X23 1 1 drink = coffee 1 =cof fee 1 =upda te_knowledcje 
opera t ion=upda t e_ know ledge dr ink=$2 . drink 
15 like X27 1 1 drink-tea '-tea 1 =npda t e knowl edge 

opera tion=update_knowl edge drink=$ 2 . dr ink 

like X29 1 1 drink=co£fee '^coffee * =reques t_dr in k 
opera cicn = requesc_drink 

20 The bigram table includes fragments of slot specification rules. For instance the bigram 

X23 X32 includes the fragment drink=$l .drink. This is derived from the rule: 
S -> X28:X23 like X29:X2S X30:X30 X31:X3l X23:X23 X32:X32 5,1) i 
drink -SX 22. drink opera t ion~$X28 . operat ion } 

25 If there was a conflicting slot specification rule, defined in another production rule, the 

bigrarn would be marked as unchunkable and would not be chunked. 

Step 12 

Based on the bigram table the first bigram rule to be created would be: 
30 X33 -> X21.-X21 like (30,2) { operat ion=$X21. operation } 
Substituting this rule into the grammar would result in 

S -> X33:X33 X23:X23 X24:X24 X25:X25 X26:X26 10,1) ( dr in k=$X2 3 . drin k 
operat ion=$X3 3 . operation } 

S -> X33:X33 X27:X27 X24:X24 X25:X25 X26:X26 20,1) I drin k=$X27 . drink 
35 opera tion=$X33 . opera tion } 

S -> X28:X28 like X29:X29 X30:X30 X31:X31 X23:X23 X32:X32 5,1) { 
dr ir.k = $X2 3 . drin k opera t ion=$X28 . opera t ion } 
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X21 


-> 


X23 


-> 


X24 


-> 


X25 


-> 


X26 


-> 


X27 


- > 


X28 


-> 


X29 


— > 


X30 


- > 


X31 


- > 


X32 




X33 


- > 



in (30,-2) 1 operation=update_knowledge 



5 (5,1) { drink=coffee opera t ion=request_drink } 
:up (5,1) { drink=coffee operat ion=reques t_drink } 
10 X31 -> of (5,1) { drink=cof f ee operat ion=reques t_dri nk } 

please (5,1) ( drin k=cof f ee opera tion=reques t_drin k } 
X21:X21 like (30,2) | operation=SX21 . operation } 



The bigram table would then become 
15 X21 like 1 1 " =updat acknowledge ope ra i ion=upda te_k now! edge 

operat.ion=5 1 .operation 

X2 3 X2 4 1 I drink=cof f ee '-coffee - =upda t e_ knowledge 
opera tion=update_knowledge drink=S 1 . drink 

X23 X32 1 1 drink=coffee ' =co f fee 4 = request_dr ink 
20 opera tion-request_drink drink=$ ! . dr ink 

X24 X25 2 2 -=upda te_knowledge opera tion = upda te_ know.l edge 

X25 X26 2 2 4 =upda ce_knowJ edge opera t ion = updd ce__knowI edge 

25 X27 X24 1 1 drink=tea * = tea * =upda te_kncwledge 

opera tion=update_knowledge drink=$l . drink 

X28 like 1 1 drink-coffee ' =co f f ee 4 =request_drink 
opera tion=request_drink operational .operation 

X29 X30 1 1 drink»cof f ee '-coffee 4 =request_dr in k 
30 operat ion=reques t_drink 

X30 X31 1 1 drink^coffee *=coffee * =reques t_dr ink 
operat ion = reques t_dr ink 

X31 X23 1 1 drink=coffee *=coffee 1 =request_dr ink 
opera tion=reques t_dr ink drink=$2 .drink 
35 X33 X23 1 1 drink=coffee *=coffee * =update__ knowledge 

operat ion=update_knowl edge drink=$2 . drink operat ion-S 1 . operation 

X33 X27 1 1 drlnk=tea *=tea 4 =upda te_knowledge 
opera tion=update_knowledge drink=$2 .drink operation=$l .operation 
like X29 1 1 drink-coffee *=coffee * = reques t _drink 
40 opera tion=request_crink 
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Steps 13 and 14 below show the subsequent step in the chunking phase. As new rules 
are created the bigram and monogram tables are updated. Although these tables cater for the 
creation of rules of length one and two respectively rules of longer length can be created from 
them, due to the fact that a symbol in the bigram table can be expanded into more than one 
symbol. 

Step 13 

S -> X33:X33 X23:X23 X34:X34 X26:X26 10,1} j drink-$X23 . drink 
opera tion=$X33 . operation ) 

S -> X33:X33 X27:X27 X34:X3<1 X26:X26 20,1} | drink=SX27 . drink 
opera t ion = $X33 . operation I 

S -> X28:X28 like X29:X29 X30:X30 X3l:X31 X23:X23 X32:X32 5,1) ( 



d r i n 




$X23 . drink opera t ion = $X28 . opera Lion } 


X21 


- > 


i (30,1.) { opera tion=update knowledge \ 


X2 3 




coffee (15,2) { drink=coffee } 


X24 


— > 


in (30,1) { operat ion=upda te knowledge } 


X2 5 


- > 


the (30,1) ( operat ion=upriate knowledge } 


X26 


— > 


morning (30,2) { operation-update knowledge } 


X27 " 




tea (20,1) ! drink«tea opera u ion -upca c e knowledge } 


X2 8 


- > 


i'd (5,1) ( drink-cof fee opera t ion^reques c drink } 


X2 9 


-> 


a (5,1) ( drink=coffee opera t ion^request drink ) 


X30 


-> 


cup (5,1) ( drink=coffee ope ra cion= reques t drink } 


X31 


-> 


of (5,1) { drink=coffee ope ra t ion=request drink } 


X32 


- > 


please (5,1) ( dri n k=co f f ee opera t ion=request drink 


X33 


-> 


X21:X21 like (30,2) { operat ion=$X2 i . opera t ion I 


X34 


- > 


X24 :X2A X25:X25 {30, 2) 



The bigram table would then be: 

X21 like 1 1 *=update_knowledge operat ion=update_knowledge 
operational .operation 

X23 X32 1 1 drink = coffee *=c;offee • =request_dr ink 
operat ion=reques t_drink drink=$ 1 . drink 

X23 X34 1 1 drink=cot f ee. --coffee • -updar.e_knowledge 
operat ion=cpdate_knowledge drink=$l .drink 

X2<3 X25 1 1 * =update_ knowledge opera t ion=upda te_knowi edge 
operational .operation 
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X27 X34 1 1 drink-tea *=tea * =upda te^knowledge 
opera t ion=upda te_knowledge drink=$ 1 . drink 

X28 like 1 1 drink=coffee 4 =coffee ' =request_drink 
opera tion=request_drink operational . operation 

X29 X30 1 1 drink=coffee *=coffee * =reques t_drink 
opera t ion=request_drink 

X30 X31 1 1 drink=coffee *=corfee ~=request_drink 
opera tion = request__dr ink 

X31 X23 1 1 drink=coffee '=cotfee i =requesc_dnnk 
opera t ion=reques t_dr ink drink=$2. drink 

X33 X2 3 1 1 drink=cofree ; =coi:fee * = upda te_knowl edge 
opera t ion=upda te_knowledge drink=$2 .drink opera r : ion = $ 1 . opera z ion 

X33 X27 1 1 drink=tea *=tea * -updat e__knowledge 
opera tion=update_knowl edge d r ink=$2 . drink opera t ion = $ 1 . operation 

X34.X26 2 2 ■ «update_knowledge operation=update_knowiedge 

like X2 9 1 1 dr ink=cc free *=coi:fee * =request_drink 
opera t ion- request_dr in k 

Step 14 

S -> X33:X33 X23:X23 X35:X35 10,1) ! rinnk = $X23 . drink 
opera t ion=$X3 3 .operation J 

S -> X33:X33 X27:X27 X35:X35 20,1) [ crink=$X27 . drink 
opera t ion=SX 33 . operation } 

S -> X23:X28 like X29:X29 X30:X30 X3i:X3i X23:X23 X32:X32 5,1) ( 
drink=$X23 . drink opera tion-$X28 . operat ion } 

(30,1) { operation=update_knowj edge } 
ffee (15,2) { drink-coffee } 



X21 


- > 


X23 


— > 


X2<3 


-> 


X25 


- > 


X26 


- > 


X27 


-> 


X28 


-> 


X29 


-> 


X30 


-> 


X31 


- > 


X32 


-> 


X33 


-> 


X35 


-> 



morning ("30,1) { operat ion=upda t.e knowledge 



of (5,1) I drink=coffee ope ra t :on=reques t_drink \ 
please (5,1) ( drink=coffee operat ion« request Jd rink } 
X21:X2i like (30,2) { opera t ion-$X2 1 . ope ra t i on } 
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Step 15 

At this point the grammar is pruned of redundant slot specification rules. This is determined 
by checking even' rule that uses the ruie being pruned, and finding out what attributes it uses. 
For instance if we examine the non-terminal X24 in the grammar above, It is used in the 
following rule: 

X35 -> X24:X36 X25:X37 X26:X26 (30 2 ) 
This rule makes no reference to the "operation" slot therefore the slot specification rule 
( opera c ion=upcia te_knowledge } 
is pruned from the rule. 

After the pruning phase which prunes slot specification rules the grammar is 

S -> X33:X33 X23:X23 X35:X35 10,1) { :iri nk=$X23 . drink 
opera c ion«$X33 . opera t ion } 

S -> X33:X33 X27:X27 X35:X35 20,1) { dr ink=$X27 . dr in k 
opera t ion=$X3 3 . opera f. icn } 

S -> X28:X23 like X29:X29 X30:X30 X3i:X31 X?3:X23 X32:X32 5,1) [ 

drink = $X23 . drink opera c ion--$X28 . opera cion } 

X21 -> i (30,1) ( operauion=upda ce_knowledge } 

X2 3 - > coffee (15,2) { dr j nk=cof fee } 

X2'l -> in (30, 1) 

X2 5 -> the { 30, 1 } 

X26 -> morning (30, 1 ) 

X27 -> tea (20,1) { drink=tea opera cion=update_knowledge } 
X28 - > i'd {5,1} { drink=cof f ee ope ra t ion=r eques t_drink } 
X29 -> a (5, 1) 
X30 -> cup "(5, 1 ) 
X31 -> of (5, 1) 
X32 -> please (5,1) 

X33 -> X21:X21 like (30,2) { opera t ion=$X2 1 . opera t ion } 
X35 -> X24:X36 X25:X37 X26:X26 (30 2 ) 

again, after pruning slot specification rules the grammar is 

S -> X32:X32 X22:X22 X35:X35 10,1) { drink=$X22 . drink 
operation=$X32 . operation } 

S -> X32:X32 X26:X2G X35:X35 20,1) { dr in k=SX2 6 . drink 
opera tion=$X 32 . opera t ion 1 
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S -> X27[X27 like X28:X28 X29:X29 X30:X30 X22:X22 X31:X3l 5,1) { 
drink=$X22 .drink opera t ion=$X27 . operation } 

X21 -> i (30,1) { opera tion=update_knowledge } 

X22 -> coffee (15,2) { drink=coffee } 

5 X23 -> in (30, 1 ) 

X2A -> Che (30, 1 ) 

X25 -> morning (30, 1 ) 

X26 -> tea (20,1) { drink=tea } 

X27 -> i'd (5,1) { operat ion=reques t_drink } 

10 X28 -> a (5,1) 

X29 cup (5, 1) 

X30 -> of (5, 1) 

X3 1 -> please ( 5, i ) 

X32 -> X21 : X21 like '(30, 2) { operai ion=SX2 1 . operation } 

15 X35 -> X23:X36 X24 :X37 X2S:X25 (30,2) 

If the rule unity rule is then applied the grammar becomes 



Step 16 

20 S -> X32:X32 X22:X22 X35:X35 (10,1) { drink=$X22 . drink 
ope r a c ion = $ X 3 2 . ope r a c i on } 

5 X32:X32 X2G:X26 X35:X35 {20,1) | dr in k = $X2 6 . dr ink 
ope r a c i on - $X 3 2 . ope r a z i on ) 

S -> X27:X27 like a cup of X22:X22 please (5,1) ( drink=$X22 . drink 
25 operacion^$X27 . opera t ion } 

X21 -> i (30,1) ( operation=update_knowledge ) 

X22 -> coffee (15,2) { drink-coffee } 

X26 -> tea (20,1) { drink-tea } 

X27 -> i'd (5,1) { opera t ion = requesr__drin k } 
30 X32 -> X21:X21 like (30, 2) { opera tion=$X2 1 . operation ) 

X35 ~> in the morning (30,2) 

The merging phase procedure 54 ; uses a list of rules that are examined for merging 
evidence patterns. This list is known as the Merge Agenda. At the beginning of the merging 
35 phase all rules are added to the Merge Agenda. Each rule on the Merge Agenda is examined 
and processed to determine when there is evidence for effecting a merger. Based on principle 



WO 00/78022 



PCT/AU00/00651 



-46- 



(3), a set of evidence patterns is established to determine when merging needs to occur. The 
four evidence patterns and the required merger action is recited in Table 1 below. 



IIjVIUciILt. 


Action 


Y *s \ R 
A r\ D 


Merge B and C 


V *> A C 
A --^ r\ 


X -> A Y 




Y -> R 

1 u 




y -> r 




Merge A and C 


X ■> C B 


X -> Y B 




Y -> A 




Y -> C 


X -> A B C 


Merge B and D 


X -> A D C 


X -> A Y C 




Y -> B 




Y D 


X -> A D 


Merge A and F E 


x -> r e i;) 


x ->"y d 




Y -> A 




Y -> F E 


X -> ,\ 13 


Vlerge B and C O 


X -> A C 0 


X -> A Y 




Y -> B 




Y -> C 0 


X -> A 


Merge A and B. where both are non-terminals 


X -> B 





Table 1 



For all of the actions described in the above table, with the exception of the last action 
involving deleting the evidence rule, the symbols which are merged may be non-terminals or 
terminals. For the merge to occur the slot specification rules when expressed in relative form 
for both rules need to be identical. In addition the terminals to be merged need to return 
identical types. If a symbol to be merged is a non-terminal, then it is not necessary to create 
a rule of the form Y -> A where only one symbol is on the right hand side. A rule Y -> a only 
needs to be created for terminals involved in the merger. If. for example, all of the symbols 
to be merged are non-terminals, then the symbols can be replaced on the right hand side "and 
left hand side of the rules of the grammar in which they appear with a reference to a new non- 
terminal, and no additional rules need to be created. 
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If there is evidence for the merge, the merger is executed, as explained further below. 
Any redundant rules are deleted and any rules changed as a result of the merging are added to 
the Merge Agenda. Operation then proceeds to determining whether any rules should remain 
5 on the Merge Agenda. If not : a rule is taken off the Merge Agenda. If the last rule has been 

reached, the procedure ends. 

Continuing on from the previous example after the end of the pruning phase 301 the 
grammar expressed in relative format will be as follows: 

10 5 X32:X32 X22:X22 X35:X35 {10,11 I drink=$2 . drink 
one raci on = $ 1 . opera c ion } 

S -> X22:X32 X2G:X25 X35:X35 (20,1) { drink=$2 . drink 
ope r a t ± on = $ 1 . ope r a t i on } 

5 - > X27 : X2"> like a cup of X22:X22 please (5,1) ( drink=*$6 . drink 
1 5 •..pera"ion--S 1 . ope r.r. r i on } 

Y.2\ -:■ l {30,1; i cperau : orv^upda ce_ knowledge } 

X22 - cot res (1.5,2: \ dr ink=co f f ee } 

X2o - ■* Lea (2Q, 1) •: drink=tea } 

X2~ - i'd (5,1) { opera zi o:i = reques c_dr ink } 
20 XjI - - X2 1:X2.1 Like [?S t 2)\ ope va I ion = S 1 . opera t ion \ 

X35 -> in the morning ( 30.2) 

Using the four different merging patterns listed in Table I s the grammar is altered as 
follows: 

25 Step 1 7 (merge X22 and X26) 

3 -> X32:X32 X3S:X26 X35:X35 (30,1) { drink=$2 . drink 

ope rat ion=$l . operation I 
■ S -> X27:X27 like a cup of X38:X22 please (5,1) { drink=$ 6 . drink 

opera t ion =$1 . operac ion } 
30 X21 -> i (30,1) { opera tion=update_knowledge ) 

X38 -> coffee (15,2) { rir in k=co f fee } 

X3S -> tea (20,1) I drink=tea' } 

X2"? -> i'd (5,1) { operat ion- reques t_drin k } 

X32 -> X21:X2j Like (30,1)1 operational . operation ) 
35 X35 -> in the morning (30,1) 
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Using the doubly linked list structure, only the symbol on the left hand side needs to 
be changed for all of the rules that use it. In the example given X22 and X26 are non-' 
terminals. If one of the symbols to be merged is a terminal a rule is created with that symbol 
on the right hand side. 

5 

Principle (4) is satisfied by the chunking and merge procedures 52 and 54 adjusting the 
hyperparameters. When a rule for a phrase is added, the hyperparameter of a rule is equal to 
the sum of the hyperparameters of the two rules that use it. When a phrase rule is added that 
uses an existing rule, the hyperparameter of the existing rule is increased by the 
1 0 hyperparameter of the new rule. -When two rules are merged, the hyperparameter of the newly 
formed rule is the sum of the two previous hyperparameters. 

Once the model merging process is completed principle (2) can be applied to rules that 
have slot specification rules and rule counts of one. If this is done to the previous example the 
j 5 grammar in absolute mode becomes 

S -> 1 like X38:X26 in zhe morning (30,1) { drmk = $X2 6 . drink 
c p e r a c i o n = u p d a c e _ k n o w .1 e d g e 1 

5 - i'ci like a cup of X33 : X22 please (5,1) { drink=$X22 . drink 
r.pe ra ■'. ion = :'eques u_d ri n k } 
20 X33 - > coffee (IS, :? i i drink-coffee } 
X 3 8 - ^ t; e a { 2 0 , 1. ) { d r i n k = t e a } 



The grammar can then be made more human readable by performing the following: 
(i) Removing all variables that are not referenced. 
25 (ii) Non-terminals are assigned names that reflect the slots they return. 

(iii) Non-terminals that do not return a value, but reflect synonyms are renamed. 

For instance 
X23 the (1,2) 
30 X23 a 

Can be renamed 
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The(l,2) 
.The a (1,1) 

Variables can also be assigned lower case names with small numbers. Using this 

5 technique the grammar becomes 

S -> I like Drink: xi in the morning (30,1) ( drin k=$x 1 . drink 
opera t ion=upda te_knowledge ) 

S -> i'cI like a cup of Drink :xl please (5,1) { drink=$xl . drink 
opera t ion =reques t_dr ink } 
10 Drink -> coffee (15,2} { drink=co t fee } 
Drink -> tea (20,1) i drink=tea } 

After the model merging procedure is completed the probabilities of the rules can be 

calculated 

15 $ -> I like Drink: xi in the morning (30,1) { drin k=$>:l . drink 
ope r a c i o n - u pd a ;: e _ k now 1 edge i - - p r ob (30/35} 

S -> i'd like a cup of Drink :xl please (5,1) ( dr in k=$xl . drink 
ope rat ion=reques t_drink ) prota = (5/35) 

Drink -> coffee (15,2) I drink=coffee ) — prob = (15/35) 
20 Drink -:■ tea (20,1) { drink-tea } prbb - (20/35) 



It can be seen that the new grammar is more general than the observations. For 

instance it can generate the phrase 

i'd like a cup of tea please 

25 

According to the inferred grammar the meaning of this phrase is determined to be 
operation=request_drink drink=tea 

The probability of this phrase is calculated to be 5/35 * 20/35 ~ 0.08. 

30 

Merging nearly always reduces the number of rules as whenever a merge is identified 
"either two rules are merged or one is deleted. When two rules are merged, one rule is deleted 
and the hyperparameter of one is increased by the hyperparameter of the deleted rule. 
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In order to operate well, the model merging procedure 50 uses as a data structure to 
ensure the following operations are executed with efficiency: 

(a) Appending a symbol to a rule. 

(b) Merging rules. 

5 

In the data structure: 

(i) Each word is replaced by a single integer representing the word. 

(ii) Each symbol is represented by a staicture that contains a symbol identification 
(id) number, plus a pointer to the previous and subsequent symbol in a rule. 

10 Each rule has guard symbol fi which points to both the first and the last 

symbols in the rule. This implements the doubly linked list. 

(iii) Each rule is attached to a structure representing a non-terminal. 

The data structure and its use is illustrated in Figure 7 which show how the data 
1 5 staicture changes for appending a symbol. 

All non-terminals are referenced in two global associative arrays, which associates the 
non-terminal id with the non-terminal. The first array is known as the rule array, and contains 
all of the rules attached to a given non-terminal. The second is known as the monogram table 

20 and contains references to all of the occurrences of that non-terminal on the right hand sides 
of rules. If states A and B are to be merged, then all non-terminal structures referenced in the 
rule array are accessed and the non-terminal id on each of these is changed. Occurrences of the 
merged symbols on the right hand side are modified by iterating through all references 
contained in the monogram table. To enable merges to be rolled back, copies are made of 

25 monogram table entries, and rule array entries prior to a merge. The merge is then performed 
and tests for problems such as recursion or added ambiguity are then undertaken. If these tests 
suggest that a merge should not occur then the merge is rolled back. All relevant associative 
arrays and hash tables are then updated. 
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During the merging phase a set of rules known as the merge agenda exists which 
contains all of the rules that should be examined for merging evidence. At the end of the 
chunking phase all rules are added to the merge agenda. They are removed from the list, either 
prior to being examined or when the rule is deleted. Rules are added to the merge agenda when 
they change, usually due to (he merging of two non-terminals. The list of rules are iterated 
through, by the use of a pointing iterator, as shown in Figure 8. The rules are iterated through 
in a re-entrant fashion. In this context re-entrant means that a rule could be deleted, and the 
remaining rules could be iterated through without affect. This is achieved by storing the rules 
in the global doubly linked list format. As shown in Figure 8. initially the iterator points to rule 
1 : and then subsequently is incremented to point to rule 2. Then if rule 2 is to be deleted, prior 
to deletion of the rule, the rule is removed from the doubly linked list, and then the iterator is 
• incremented to point to rule 3. 

The model merging process 50 is able to infer grammars of arbitrary' complexity for 
categorical data. It achieves this by assuming that the results of slot specification rules are 
visible on the end result. The inferred slot specification rules only have assignment operators, 
i.e. product=isdn or product=$x. product. This technique can be extended to both strucrured 
data and integers. Structured data can be included by considering the members of a structure 
as separate slots. For instance consider the structure date, with four members, { year, month, 
day_ofmonth, and day_of_week }. If during the model merging technique these are 
represented as four separate slots eg { date.year, date. month, date.day_of_month, 
date.day_of_week} then the model merging process need not be modified. 

Numerical data such as integers and floating point numbers can likewise be converted 
to categorical data. A more useful technique however is to use a predefined grammar for 
numbers, which can be included , for instance during the templating process. Such a grammar 
is defined in Appendix 9 for example. To accommodate this grammar the grammar defined 
in Appendix 10 can be extended to include mathematical operators, such as addition, 
subtraction, multiplication and division. During the incorporation phase of model merging, any 
observations that can be parsed by this grammar will be, and generalisation can continue on 
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those other parts of the grammar. To do this however the rules of the predefined grammar need 
to be denoted as fixed. In the grammar format used in this document this is noted through the 
use of the exclamation at the beginning of the rule. Rules that are fixed cannot be altered in 
any way. To accommodate fixed rules the following modifications are required. 

5 

If a non-terminal has any fixed rules, then that non-terminal cannot be merged with any 
other non-terminal. 

Fixed rules cannot be deleted, nor can their probability be set to zero. To prevent this 
1 0 occurring, during the reestimation phase all fixed rules have an additional count of 1 added to 
the count obtained by parsing the examples. 

Fixed rules cannot be chunked. If the R.HS of a new rule is contained in a fixed aile, 
it will be substituted. In addition the rule counts using during the chunking phase will not 
1 5 include fixed rules. 

Another important feature of the model merging procedure 50 is where the generated 
grammar cannot be recursive. 

20 During the merging phase 54 the merge is tested to see if it generates a recursive 

grammar. If it does the merge is reversed. Grammar can be tested for recursion using a number 
of techniques. A preferred method involves execution of a recursive procedure 200, as shown 
in Figure 9 which sets a variable current non-terminal to be the top-level grammar at step 202 
and then calls a traverse node procedure 250, as shown in Figure 10, which initially operates 

25 on an empty list of non-terminals. The procedure 250 is used recursively to test all of the rules 
in the grammar that have a particular non-terminal on the left hand side of a rule. A list of non- 
terminals that have been previously checked is passed to the procedure 250 when subsequently 
called. The current non-terminal is added to the list of previously tested rules at step 252 and 
at step 254 the next rule with the current non-terminal on the left hand side is accessed. A test 

30 is then executed at step 256 to determine if the last rule has been reached. If yes then a variable 
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recursive is set to false at step 258 and the procedure completes. Otherwise if the last rule has 
not been reached then the next symbol in the rule is retrieved at step 260, and a determination 
made to see whether the symbol exists in the symbol list, i.e. if a non-terminal appearing on 
the right hand side already exists in the list of previously tested non-terminals. If so, the 
variable recursive is set to true at step 264 and the procedure completes. If not, another 
instance of the procedure 250 is executed on the non-terminal. When an instance of the 
procedure 250 generated in this manner completes a test is made at step 266 to determine if 
the variable recursive is true. If so, the procedure completes, otherwise a test is then made to 
determine whether the last symbol in the non-terminal list has been reached at step 268. If not, 
operation returns to step 260, otherwise operation will return to step 254 to retrieve the next 
rule. 

To illustrate how the procedures 200 and 250 operate, Table 2 below sets out the 
sequence of the rules examined and the compilation of the non-terminal list for the following 
grammar: 

S -> a XI b 
S -> d e 
XI -> a X2 b 
XI -> a S b 
X 2 - > i 





Rule Being Examined 


Non-Terminal List 


(i) 


S ->a XI B 


S 


(ii) 


X 1 -> a X2 b 


S,X1 


(iii) 


X2 -> i 


S.X1.X2 


(IV) 


XI ->aSb 


S,X1 Grammar is recursive 



Table 2 



The table shows that the top-level grammar S is checked first. When checking the first 
rule, the non-terminal list contains only the symbol S, and when the symbol XI is checked in 
the first rule, the procedure 250 is called recursively to check if any of the rules attached to XI 
are recursive, and the symbol XI is added to the list. The symbol X2 is encountered and also 
added to the list. When the symbol S is encountered in the right hand side of the second rule 
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for XL the procedure 250 identifies at step 262 that this symbol already exists in the list, and 
the grammar is then identified as recursive and the procedure completes. When a test is 
executed to determine whether a grammar is recursive, and the grammar is known not to be 
recursive prior to executing a merge, the test for recursion can start with the newly merged 
non-terminal rather than the top-level grammar. This will reduce execution time when the 
newly merged non-terminal is not a top-level non-terminal. 

Dunne the merging phase a test is undertaken to ensure the possibility of introducing 
ambiguity as a result of merging two symbols is reduced. If the merging of two symbols causes 
two rules to exist with the same syntax but with differing slot specification rules, where the 
slot specification rules of the form X=Y, then the merge is rolled back. For instance: 

XI -> Y:xl Z:x2(2,l) {op=a x=Sx 1 .X y- 5x2. Y} 

XI -> Y:X1 Z:X2(1,2) {op=a x=Sx 1 .X y= $x I . Y} 
is acceptable, but 

XI -> Y:xl Z(U) {op=a X=Y Y=$X2.Y} 

XI -> Y:xl Z(U) {op=aX=Z Y=SX2.Y] 
is not acceptable. 

Ail of the processes and components of the development system 40 are preferably 
executed by a computer program or programs. Alternatively the processes and components 
may be at least in part implemented by hardware circuits, such as by ASICs. Hie components 
may also be distributed or located in one location. 

Many modifications will be apparent to those skilled in the art without departing from 
the scope of the present invention as herein described with reference to the accompanying 
drawings. 
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APPENDIX 1 



<?xml version^' 1 . 0 ? encodings 1 ut f -8 ' ?> 
<APPLICATION NAME— "Stock" > 

<ENUMERATED .NAME- "s t ockname "> 

< ITEM NAME="philp burns"/> 

<TTEM NAME="macquarie qanmacs"/> 

< ITEM NAMEf " a i engineering " /> 

< ITEM NAME="a p eagers iimited"/> 

<ITEM NAME="a ape limited "/> 

< ITEM NAME="a apt limited"/> 

<ITEM NAME="abador gold "/> 

<ITEM NAME="abednego nickel "/> 

<ITEM NAME="aberfoyle limited"/> 

< ITEM NAME="abigroup limited"/> 

< ITEM NAME="arthur yates "/> 

< ITEM NAME="york securities " /> 

< I T EM NAME="zeolite australi.a'7> 

< ITEM NAME-" zephyr " minerals "/> 

< ITEM NAME- " z i com aus t ral ia " /> 

<ITEM MAME=" Zimbabwe platinum"/> 

< I T EM NAME="zylotech limited"/> 
</ENUMERATED> 

<OPERAT10N NAME="buy" > 

< PARAMETER NAME= " s t oc kname " TYPE="s toe kname "/> 
' < PARAMETER NAME=" number" TYPE-" INTEGER" /> 
< PARAMETER NAME=" price" TY PE= "money " / > 
■c /OPERATION* 

'.'OPERATION NAME="seli" CONFI RM- " yes " > 

< PARAMETER NAME- " s toe kname " TYPE- " stock name " / > 

< PARAMETER NAME- " nunibe r " T Y PE= " I NTEGER" /> 

< PARAMETER NAME- "price" TY ?E= "money "/ > 
</OPERATION> 

<OPERATION NAME- "quote " CONFIRM- "yes"> 

< PARAMETER NAME=" stock name " TYPE= " s toe kname " /> 
<RETURN NAME= M s toe kname" TY?E-"s toe kname " /> 
<RETURN NAME="date" "TYPE="da te" /> 
<RETURN NAME=" price " TYPE= "money" / > 
</OPERATION> 
</APPLICATION> 
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APPENDIX 2 



PROCESS Stock; 

DCL buystockname STOCKNAME, buynumber INTEGER, buyprice MONEY, 
sellstockname STOCKNAME, sellnumber. INTEGER, sellprice HONEY , 
quotes tockname STOCKNAME, quotedate DATE , quoteprice MONEY; 

START; 

OUTPUT TopLevelStock; 

NEXTSTATE TopLevelStock; 

STATE TopLevelStock; 

INPUT buy (stocknarae, number, price) ; 
TASK buystockname = s tockname; 
TASK buynumber - number; 
TASK buyprice = price ; 
CALL As kbuys tockname ; 
CALL As kbuynumber ; 
CALL Askbuyprice; 
CALL Completebuy; 
NEXTSTATE TopLevelStock; 

INPUT sell ( seockname , number, price); 
TASK se I 1st oc knams = s tockname ; 
TASK sellnumber - number; 
TASK sellprice = price; 
CALL As kse lis tockname ; 
CALL As ksel 1 number ; 
CALL Asksellprice; 
CALL Con f irmCompletesell ; 
NEXTSTATE TopLevelStock; 

INPUT quote ( seockname ) ; 

TASK quotes tockname = stockname; 

CALL Askquotestockname; 

CALL Completequoce ; 

NEXTSTATE TopLevelStock; 
. STATE * ; 
/* This applies to all stales */ 
INPUT cancel; 

OUTPUT operat ioncancelled; 

NEXTSTATE TopLevel; 

INPUT help; 

OUTPUT helpstate 4 ; 

/* The name of the state is appended to 
the prompt name V 
NEXTSTATE -; 

/■* return to the same state */ 

INPUT quit; 
OUTPUT quit; 
STOP; 

ENDPROCESS Stock; 

PROCEDURE Askbuystockname; 
START; 

DECISION buystockname; 
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(=""): 

OUTPUT Askbuystockname; 

NEXTSTATE Wait Repl yAs kbu y s t oc kname ; 

'{/= "") : 
RETURN; 

ENDDECISION; 

STATE Wait Repl yAs kbuy s t oc kname ; 

INPUT buystockname (stockname, number, price)-; 
CALL setbuystocknamel f NotNii (stockname) ; 
CALL setbuynumberlf Not Nil (number) ; 
CALL setbuypricel f Not Nil (price) ; 
RETURN; 

ENDPROCEDURE Askbuys toe kname ; 

PROCEDURE setbuystocknamel £ NotNii ; 
FPAR IN /OUT s tec kname STOCKNAME; 
START; 

DECISION stockname; 
{= "") : 
RETURN; 

(/= "") : 

TASK buystockname = stockname; 

ENDDECISION; 

END PROCEDURE setbuystocknamel fMocNii; 

PROCEDURE Askbuynumber; 
START; 

DECISION buynumber; 
( = " " ) : 

OUTPUT Askbuynumber; 

NEXTSTATE Wa i t Repi yAs kbuynumber ; 

(/= "") : 
RETURN; 

ENDDECISION; 

STATE WaitReplyAskbuynumber; 

INPUT buynumber (number , price); 

CALL setbuynumberlf NotNii (number) ; 
CALL setbuypricel f NotNii (orice) ; 
RETURN; 

ENDPROCEDURE Askbuynumber; 

PROCEDURE set buynumber I f NotNii ; 
FPAR IN/OUT number INTEGER; 
START; 

DECISION number; 
(= "") : 
RETURN; 



(/= ,,M ) 

TASK buynumber = number; 



WO 00/78022 



PCT/AU00/00651 



- 58- 



ENDDECISION; 

ENDPROCEDURE setbuynumberlfNotNil; 

PROCEDURE Askbuyprice; 
START; 

DECISION buyprice; 
(= "") : 

OUTPUT Askbuyprice; 

NEXT STATE Wa i t Repl yAs kbuypr ice ; 

(/= MM ) : 
RETURN; 

ENDDEC I S IOM ; 

STATE Wai t Repl yAs kbuypr ice ; 
INPUT buyprice (price ) ; 

CALL setbuypricel fNotNii (price) ; 
RETURN; 

ENDPROCEDURE Askbuyprice; 

PROCEDURE secbuypricel fWotNi 1 ; 
FPAR IN /OUT price MONEY; 
START; 

DECISION price; 
(= ""): 
RETURN ; 

(/= ""): 

TASK buyprice = price; 

ENDDECISIOM; 

ENDPROCEDURE setbuypr icel f Not Nil ; 

PROCEDURE Completebuy; 
START; 

CALL buy ( buys toe knarne , buynumber, buyprice) ; 

OUTPUT buyConf irmed; 

NEXTSTATE Wai t Con f i rrnbuyEnd ; 

STATE Wa i t Con fi rrnbuyEnd; 
INPUT continue ; 
RETURN; 

ENDPROCEDURE Comple tebuy ; 

PROCEDURE Asksellstockname; 
START; 

DECISION sellstockname; 
(=""): 

OUTPUT Asksellstockname; 

NEXTSTATE Wa i t Repl yAs kse 1 i s toe knane ; 

(/- "") : 
RETURN; 
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ENDDECIS ION ; 

STATE Wait Repl yAsksell stockname ; 

INPUT sellstockname ( scockname, number, price); 
CALL setsellstocknameIfNotM.il (stockname) ; 
CALL setsellnumber I f NotNil (number) ; 
CALL setsellpricel f Not Nil (price ) ; 
RETURN; 

END PROCEDURE Asksel Is t oc kname ; 

PROCEDURE setsellstocknamel f NotNil ; 
FPAR IN/OUT stockname STOCKNAME; 
START; 

DECISION stockname; 
(= "") : 
RETURN ; 

(/ = ) : 

TASK sellstockname = stockname; 

END DEC I SION ; 

ENDPROCEDURE setsellstocknamcl f NotNil ; 

P ROC E DURE A sksellnu mb e r ; 
START ; 

DECISION selinumber; 
(= "") : 

OUTPUT As kseli number; 

NEXT STATE Wa i t Repl yAs ksei inumbe r ; 

(/= "") : 
RETURN; 

ENDDECISION; 

STATE Wa i t Repl yAs ks e 1 1 numbe r ; 

INPUT selinumber ( numbe r , price); 

CALL set sell number I f NotNil (number) ; 
CALL setsellpricel f Not Nil (price ) ; 
RETURN ; 

ENDPROCEDURE As kse 1 Inumbe r ; 

PROCEDURE set selinumber I f Not Nil ; 
FPAR IN/OUT number INTEGER; 
STARTS- 
DECISION number; 
(= "") : ' 
RETURN; 

(/= ) : 

TASK selinumber = number; 

ENDDECISION; 

ENDPROCEDURE set selinumber I f NotNil ; 



PROCEDURE Asksellprice; 
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START; 

DECISION sellprice; 
(= : 

OUTPUT Askseilprice; 
NEXTSTATE WaitReplyAsksellpri.ee; 
(/=» "") : 
RETURN; 

ENDDECISION; 

STATE WaitReplyAsksellprice; 
INPUT sellprice (price) ; 

CALL setsellpricel fNotWil (price) ; 
RETURN; 

ENDPROCEDURE As ksei 1 price ; 

PROCEDURE setsellpricelf NocMil; 
FPAR IN /OUT price MONEY; 
START; 

DECISION price; 
( = " " ) : 
RETURN ; 

(/= ""): 

TASK sellprice - price; 

ENDDECI S I ON ; 

ENDPROCEDURE setsellpricel Lttotiiii ; 

PROCEDURE Conf irmCompleteseii ; 
START; 

OUTPUT AskConri. rrasel I { I is tcckname , selinumber, sellprice);' 

NEXT STATE Wai t As kCoru i r.r.se 1 1 ; 

STAT E Wa i t As kCon £ i rms e 1 1 ; 
INPUT yes; 

CALL sell ( seliscockname, sell number , sellprice); 

OUTPUT sellConf irrned; 

NEXTSTATE Wa it AskConf i rmsellEnd; 

INPUT no; 

OUTPUT sellCanceiled; 

NEXTSTATE Wa i t As kCon f i rms e .1 1 End ; 

STATE Wai tAskConf irmsellEnd; 
INPUT continue; 
RETURN; 

ENDPROCEDURE Conf irmCompiec esell ; 

PROCEDURE Askquotestockname; 
START; 

DECISION auotestockname; 
(= " " ) : 

OUTPUT Askquotestockname; 

NEXTSTATE Wa i t Repl yAs kquot es t oc kname ; 
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RETURN; 

ENDDECISION; 

STATE WaitReplyAskquotes tockname; 
INPUT quotestockname (stockname) ; 

CALL setquotestocknamelfNotNil (stockname) ; 
RETURN ; 

END PROCEDURE Askquotes tockname ; 

PROCEDURE se t quotes tockname I f Not Nil ; 
FPAR IN/OUT stockname STOCKNAME ; 
START; 

DECISION stockname; 
( = " " i : 
RETURN; 

{/= : 

TASK quotes tockname = stockname; 

ENDDECIS I ON; 

END? ROC E DU R E s e r. quotes t c c k name I f N o c N i 1 ; 

P F.OC E DU RE Co m p 1 e t e q u o r. e ; 
START; 

CALL qijoco (queues tockname , quciieciauc, qucteprice ); 

OUTPUT quoteCor. z. i.rmec (quotestockname, quotedate, quoteprice ); 

N E X T S T A T E W « i L C o n t i r ate u o t a E n ci ; 

STATE Wc i tCcr. f i rmqu;>i ^En:: ; 
INPUT continue; 
RETURN; 

E N D P ROC E DU RE Comp i.et equote ; 
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/* Clips output '/ 

(def facts Stock-questions 
( quest ion 

( name "Askbuys tockname" ) 

( int erac t iont ype "ask") 

(prompt "Please say the stockname") 

(grammar " . Wa i t As kbuy stockname " } 

( que s t ion 

( name "helpsta teAskbuystockname " ) 
( interact ion type "ask") 

[prompt "Please say the stockname. For example, b h p, 
commonwea 1th ban k You can say cancel to qo to the top level.") 
{ gramma r " . Wa i t As kbuyst cckname " J 

) 

(question 

{ n a me " A s kbu y numbe r " ] 
{ xnte race ion type "ask") 
(prompt "Please say Che number") 
{ q ram.ua r ,; . Wa i t As hsuynumoer ;1 } 

. que si i on 

( name " he i ps ta t e As kbu ynurnbs r " ! 
l interact ion type "ask") 

'prompt "Please say the number. For example, three hundred and 
rwenty five You can say cancel to qo to the top level."} 
(grammar ". Wa i r As kbuynumber " ) 

: ques t i on 

(name " Askbuypr ice" ) 
( into race rent ype "ask") 
(prompt "Please say the price") 
{ g r a mm a r " . W ait A 5 k b u y price") 

) 

(question 

(name "h e ipstateAs kbu yp rice " ) 
( i n t e ra c t i on t y pe "as k " ) 

(prompt "Please say the price. For example, three dollars and 
fifty cents. You can say cancel to go to the top level. ") 
( g r a mma r " . Wa i t As kbu vpr i c e " ) 

) 

i question 

(name "buyCon firmed" ) 

( interact ion type "tell") 

(prompt "buy operation confirmed") 

(grammar " . none" ) 

) 

( question 

(name "Asksel Istockname" ) 

( interact ion type "ask") 

(prompt "Please say the stockname") 

(grammar " . Wa it Asksel istockname " ) 

) 

(question 

(name "helpsta te Asksel Istockname" ) 
{ interact iont ype "ask" ) 
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( prompt "Please say the stockname. For example, b h p, 
commonwealth bank You can say cancel to go to the top level.") 
{grammar " . Wai tAsksei 1 s tockname " ) 

) 

(question 

(name "As ksel 1 number " ) 
( interact iontype "ask") 
(prompt "Please say the number") 
(grammar " . Wai tAsksei lnumber" } 

) 

( quest ion 

(name "helps tateAs ksellnumber" ) 
( i n t e rac t i on t ype "ask") 

(prompt "Please say the number. For example, three hundred and 
twenty five You can say cancel to go to the top level.") 
; g r a mm a r " . W a i c A s k s e 1 1 n u mb er") 

i 

( question 

{name " As ksel 1 p rice") 
; interactiont ype "ask") 
[prompt "Please say the price") 
[gramma r " . Wa i c As ksel ipr ice " ) 

} 

{question 

( name "helps t a t eAs k.sei _ price " ) 
(interact i one ype "ask") 

•.prompt "Please say the price. For example, three dollars and 
f \ r - rone c - Y o u c a r : s a v c 2 n c e 1. c o c o to c h e too level." ) 
•gramma r " . ivai tAsksei! price" ) 

{ a u e s c i o n 

( name " A s kCo n 1 1 r ms e 1 i " J 
{ interaction t ype "ask") 

iproir.pt "According to the system you want to sell. The stockname 
is * stocKnaine • . The number is 'number' . The price is 'price' . Is this 
correct?") 

• g r a mm a r " . Wa x t. As kCo n i i rinse 1 1 " } 

5 

(question 

( name "helps tateAs kCon f irmsell" ) 
( interact iontype "ask") 

(prompt "Please say yes or no. You can say cancel to go to the top 
level . " ) 

(grammar " . WaitAskCon i irmsell " ) 

) 

(question 

(name "sel ICancelled" ) 

( in teract iontype "tell") 

(prompt "sell operation cancelled")' 

(grammar ".none") 

) 

( quest ion 

(name "sellConf irmed" ) 

( interact ion type "tell") 

(prompt "sell operation confirmed") 

(grammar " . none " ) 

) 

(question 

(name "Top Levels tock " ) 
(" interact iontvoe "ask") 
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(prompt "Welcome to the Stock application. Please say one of the 
following buy, sell, quote") 

(grammar " . TopLevelStock" ) 

) 

5 (question 

(name "helpsta teTopLe vei Stock" ) 
( interact ion type "ask") 

(prompt "Please say one of the following options buy, sell, quote") 
{grammar " . TopLevelStock" ) 

10 ) 

(quest ion 

( name "ope ra t ioncancei led " ) 
( interactions ype "ask") 

(prompt "operation cancelled. Please say one of the following 
15 options buy, sell, quote") 

(grammar ".TopLevelStock") 

r 

t quest ion ' name quit) 

; interact ion type "end") 
20 ( prompt "goodbye") 

) 

) 
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Rule : IsFixed LHS * ->' RHS 1 (' HyperParam ' RefCount ' )' FeatureSpecRule 
Is Fixed : ' ! ' I ; 

FeatureSpecRule : ' '{' Fea tureSpeci f ica t ions '}' I ; 
LHS : Nonterminal 

ProductRule : RHS I RHS ProductRul e ; 

RHS : Nonterminal I NonTerminal ':' Variable I Terminal; 

FeatureSpeci f icat ions : FeatureSpeci f ication I 

FeacureSpeci f ication Feat ureSpeci f icat ions ; 
FeatureSpeci f ication : AsignmentRule I FunctionRule I ; 
FunctionRule : Function '('AsignmentRule AsignmentRule ' ) '; 
Function : 'add' I ' mul' I ' div' j 'sub'; 

AsignmentRule : Feature value i Feature '«' '$' Variable '.' Feature I 

Feature ' = ' ' $' Integer ' Feature I Feature 1 - ' ' H ' Integer '.' Feature; 
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APPENDIX 5 
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! Commons toe kCmds -> CancelActions (1000,1} (operation^cancel } 
! Commons tockCmds -> Repeat Action (1000,1) { opera tion=repeat } 
! Commons toe kCmds -> Short HelpAct ions (1000,1} ( opera tion=help } 
! Commons tockCmds -> QuitActions (1000,1) ( opera tion=quit } 
Stockname -> philp burns (1,1) ( s tockname="philp burns" } 
Stockname -> philp burns (1,1) ( stoc kname= "philp burns" } 

macquarie qanmacs (1,1) { s t ockname="macquar ie qarnnacs" 
a i engineering (1,1) ( s tocknarne= "a i engineering" } 
a p eagers limited (1,1) { stockname="a p eagers limited 
a a p c limited (1,1) ( stockname="a ape limited " } 
a a p t limited (1,1) { stockname- "a apt limited" } 
abador gold (1,1) ( s tockname= " abador gold " } 
abednego nickel (1,1) ( s tockname="abednego nickel" \ 
aberfoyle limited (-1,1) 1 s tockname="aber f oyle limited" 
abigroup limited (1,1) ( s t ockname- "abigroup limited" , l 
arthur yates (1,1) { stockname- "a rthur yates " ) 
york securities (1,1) ( s tockname- " york securities" } 
zeolite austraiia (1,1) 
zephyr minerals (1,1) 
zicom austraiia (1,1) ! 
Zimbabwe platinum (1,1) 
zylotech limited (1,1) 
. Wa i t Rep 1 y A s kbu y stockname - > 

( operat ion=$c . operation } 
. Wai tRepl yAs kbuys tockname -> Stockname: 
s tockname-$x . stockname } 
. W ai c Re pi y A s k bu y p r i c e - > C o mmo n $ toe k.Cmd s 



Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname -> 
Stockname 



i s toe kname=" zeolite austraiia" } 
stockname=" zephyr minerals " } 
s tockname-" zicom austraiia" } 
{ s toe kname=" Zimbabwe platinum" ) 
stockname=" zylotech limited" } 

Commons toe kCinds : c (1000, 1) 

( 1 000 , 1 ) { operation=buystockname 

-iiOOO, 1) I opera tion=Sc . operation 



Money : 
or ice . 



(1000,1) { opera tion=buypr ice 

n t s — 5 x - price . cents } 



40 ) 



. Wa i t Repl yAs kbu ypr ice - > 
price. del lars = $x . price, dol la rs 
G R_bu y - > Bu y Noun (1000,1) 
BuyNoun -> buy (1000,1) 
. Wa i tRepl yAs kse lis tockname 
( operat ion=$c . operat ion } 

. WaitRepiyAskselistockname -> Stockname::-: (1000,1) { operat ion=sells tockname 
scockname=$x . stockname ) 

. Wait Repl yAs kbu ynumber -> CommonS'cock.Cmds : c (1000,1) { ope rat ion=$c . operat ion 



Commons tockCmds : c 



(1000, 1) 



Number : :■: 



(1000, 1) 



( number=$>: . number 



Commons tockCmds : c 



(1000, 1) 



( 1000, 1) 



( number=$x . number 



. Wait Repl yAs kbu ynumber -> 
opera t ion=buynumber } 
. Wai tRepl yAs kse 11 number -> 
( operat ion=$c . operation } 
45 . Wai tReplyAs ksellnumber -> Number: 
opera t ion=sellnumber } 

. Wai tReplyAsksellprice -> CommonStockCmds : c (1000,1) { operation=$c . operation 
I 

. Wai tReplyAsksellprice -> Money:* (1000,1) { opera t ion=sellprice 
50 price . dollars=$x . price . dollars price . cent s=$x . price . cents I 
GR__sell -> SellNoun (1000,1) 
SellNoun -> sell (1000,1) 

. Wai tAskConf irmbuy -> CommonStockCmds : c (1000,1) { operat ion=$c . operat ion 
} 

55 . Wai tAskConf irmbuy -> Conf irmacion : c (1000,1) ( opera tion=$c . con fi rm } 

. Wait Repl yAs kConf irmsell -> CommonStockCmds : c (1000,1) 

{ operat ion=$c . operation 1 

. Wai tRepl yAskConf irmseli -> Confirmations (1000,1) (operation=$c .confirm 
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. TopLevelStock -> CommonStockCmds : c (1000,1) { operation=$c . operation } 
.TopLevelStock -> GR_buy (1000,1) { opera tion^buy } 
.TopLevelStock -> GR_sell (1000,1) { opera t ion=sell } 
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CommonStockCmds [ 
( CancelActions )~0.25{ return {[ <operation cancel>] ) } 
( RepeatAction )~0.25[ return {[ <operation repeat>] } ) 
ShortHelpActions }-0.25{ return {[ <operation help>])} 



( 

( QuitActions )~0.25{ return ([ <operation quit>] ) } 



) 



1 

Stock name [ 
( philp burns 
{ philp burns 
{ macquarie 
canmacs">] ) } 
( a i engineering ) -0.05555561 return 
( a p eagers limited ) -0 . 0555556 { 
iimited"s] ) } 
( a a p c limited 
( a a p t limited 
( abador gold ) -0 
( abedneao nickel 



-0.0555556{ return {( 
)~0. 05555561 return (( 
qanmacs ) -0. 05555561 



) -0.05555561 return 
) -0.055555b{ return 
05555561 return ( j 
) -0 . 05555561 return 



<stoc kname 
<stockname 
return ( [ 



'philp burns' 
'philp burns' 
<s tockname 



>] ) ) 

"macquarie 



{[ <stockname "a i. engineering ">]) } 
return ( [ <s tockname "a p eagers 



( aberfoyle 
limited">] ) } 

( abigroup 
limited" >] ) } 

{ arthur yate 



limited 



1 i mi tec 



) -0. 05555561 
) -0 . 0555556 ( 



{ | <s toe kname "a a p c limited 
( ( <s tockname "a a p t limited 
<stockname "abador gold ">))} 
( [ <s toe kname "abednego nickel 
return { ( <s toe kname 



return 



( ( 



< s tockname 



) -0.05555561 return (I 



{ york securities } -u 
( zeolite australia 
3ustralia">] ) j 
( zephyr minerals } -0 
( zicom australia ) -0 
platinum 



05555561 return 
)-0. 05555561 

05555561 return 
0555556t return 
) -0.05555561 



<s tockname 
1 <s toe kname 
return ( [ 

• [ <stockname 
{ 1 <s tockname 
return { [ 



arthur 



y o r r" s e c u r i t 
c stockname 



•>})) 
•>} ) ) 

'>] ) ) 
aber f oyle 

"abigroup 

">] ) 1 



.es">) ) } 
zeolite 



( Zimbabwe 
plat iiium "> ] ) } 

{ zylotech limited 
limited">] ) } 
j 

. TopLevelS cock ( 
{ Commons tockCmds : c ) -0.3333331 return (( <operation 
{ buy ) -0.3333331 return ({ <operation buy>])) 
{ sell )-0. 3333331 return ([ -operation sell>])| 



"zephyr minerals ">) ) } 
"zicom australia ">} ) } 
<s tockname " Zimbabwe 



) -0 . 0555556 1 return ([ •;stockname "zylotech 



$c . operations ] ) } 



. WaitReplyAskbuystockname [ 
( CommonStockCmds : c )~0.5{ return 
( Stockname : xl )~0.5{ return ({ 

$xl . stockname>] ) } 

] 

. WaitReplyAskbuyprice ( 
( CommonStockCmds : c ) - 0 . 5 { return 
( Moneyixl )~0.5{ return ([ 



50 ) 



$xl . price . dollars> <price. cents $xl 



. Wai t ReplyAsksel lstockname ( 
{ CommonStockCmds : c )-0.5{ return 
{ Stockname :xl J-0.5 1 return ([ 

$xl . s tockname> ] ) } 



(1 <operation $c . opera t ion> )) } 
<operation buystockname> <stockname 



{( <operation $c . operations ]) } 
<operation buyprice> <pr ice . dollars 
price . cents>] ) } 



{[ <operation $c . operations ]) } 
<operation sel lstocknames <stockname 



. Wai t ReplyAs kbuynumbe r I 
{ CommonStockCmds : c }-0.5{ return ({ <operation Reoperations))} 
{ Number :xl )-0.5{ return ([ <number $xl . numbers <operation buynumbers ] ) } 

) 



WO 00/78022 



PCT/AUOO/00651 



-69- 



Wai tReplyAskseilnumber ( 

( Commons tockCmds : c )~0.5{ return ([ <operation $c . opera tion> ]) } 

{ Number :xl )-0.5l return (( <number $xl.number> <operation sellnuinber> ] ) } 

WaitReplyAsksellprice [ 

{ CommonStockCmds : c ) ~0 . 5 ( ' re turn (( <operation $c . opera tion> 1 ) } 
( Moneyrxl )-0.5{ return ([ <operation sellprice> <price . dollars 
ixl . price . dollars> <price. cents $xl . price . cent s> j ) } 

WaitAskConf irmbuy [ 

( CommonStockCmds : c }-0.5{ return ([ <operation Sc . ope rat ion> ] ) } 
{ Confirmation : c )-0.5( return {( <operation $c . conf irm> ] ) ) 

Wa i t Repl yAs kCon f i rms ell [ 

( CommonStockCmds : c )-0.5{ return (( <operacion $c . opera t ion> j } } 
{ Confirmation : c )-0.5{ return ([ <operation Sc . conf irm> } ) } 
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Commons tockCmds { 

CancelActions {<operation cancel>) 
5 RepeatAction {<operation repeat>) 

ShortHelpActions (<operation help>} 
QuitActions I <operation quit>} 

] 

1 0 Stockname [ 

(philp burns) { return { "philp burns")} 

(macquarie qanmacs) { re turn ( "macquarie qanrnacs")} 

{a i engineering) (recurnC'a i engineering")} 

(a p eagers limited) {return ("a P eagers limited")} 

15 (a a p c limited ) {recurnC'a a p c limited ")} 

(a a p. t limited) {return ("a a p t limited")} 
(abador gold ) { return ( "abactor gold ")} 
{abednego nickel) { return { "abednego nickel")} 
(aberfoyle limited) { re turn ( "aberf oyle limited")} 

20 {abigroup limited) i re turn ( "abigroup limited")} 

(arthur yates ) { return ( "arthur yates ")} 
(york securities) { return {" york securities")} 
(zeolite austraiia) i re tu rn ( :: zeoii t e aust rai ia !f ) } 
(zephyr minerals ) { return (" zephyr minerals ")} 

25 (zicom austraiia) { return (" zicom austraiia"}} 

(Zimbabwe piatinuni) { re turn (" Zimbabwe platinum")} 
(zvlotech limited) { return ( " zylotech limited")} 

J 

30 . Wai z As kbuy stockname ( 
CcnunonS tockCmds 

(stockname: x J { ^operation buys t cc kname> <s tec k name 5>:>} 

) 

35 . Wai t As kbuy number { 
CoinmonS tockCmds 

(INTEGER: x) { <operation buynuiaber> < number Sx>| 

1 

40 . Wait Askbuyprice [ 
Commons tockCmds 

(money: x) { <ope ration buyprice> <price $x>} 

1 

45 GR_buy { 
buyNoun 

1 

BuyNoun ( 
50 buy 
] 

. WaitAsksellstockname ( 
Commons tockCmds 

55 ( stockname : x ) { ^operation sell s tockname> <stockname $>:>} 

I 



. Wai t Asks ell number ( 
Commons tockCmds 
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(INTEGER: x) { <operation sellnumber> <number $x>} 

] 

. WaitAsksellprice [ 
Commons toe kCmds 

'(moneyix.) { <operation sellprice> <price $x>) 

J 

GR_sell [ 
sellNoun 

1 

sellNoun ( 
sell 



• Wa i c As kCon f i rms ell [ 
ComnonS tockCmds 

LOOSE_CONFIRMATION: c {<operation $0} 

] 

. TopLevelStock [ 
Commons tockCmds 
GR_buy {<operation buy> } 
GR_sell i -'operation sell:-} 
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APPENDIX 8 



<STRUCTURE NAME="date"> 
<MEMBER NAME="month"/> 
<MEMBER NAME= "day" TYPE=" in t eger " / > 
<MEMBER NAME™" year TYPE-" integer "/ > 
<MEMBER NAME= "da y_o f _wee k " / > 
<MEMBER NAME="modif ier"/> 
</STRUCTURE> 

<STRUCTURE NAME- "price "> 

<MEMBER NAME= "dollars" TY?E=" integer " /> 
<MEMBER NAME- "cents" TYPE- " integer " / > 
< MEMBER NAME="modif ier" /> 

</STRUCTURE> 

<STRUCTURE NAME = "price " > 

<M EMBER NAME= " hours " / > 

< MEMBER NAME="minutes"/> 

< MEMBER NAME=" seconds "/> 

< MEMBER NAME="am_or_pm" /> 

<MEMBE R N AM E= "mod i f i e r " / > 
< / STRUCTURE-* 
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Number -> UpToHundred : n (1,1) { number =$n . number } 

UpToHundred -> Digitm (1,1) { number=$n . number } 

UpToHundred -> Teens : n (1,1) ( number=5n . number ) 

Number -> St rictHundredToThousand : n (1,1) { numbe r=$n . number ) 

Zero -> zero (1,1) {number=0 } 

Zero -> nought (1,1) {number=0 } 

Zero -> oh (1,1) { number =0 } 

Zero -> no (1,1) { number=0 } 

NonZero -> one (1,1) { numbe r=l } 

NonZero -> two (1,1) (number=2 } 

NonZero -> three (1,1) (number=3 } 

NonZero ~> four (1,1) (number—? } 

NonZero -> five (1,1) (number=5 } 

NonZero -> six (1,1) ( number=6 | 

NonZero -> . seven (1,1) {number=7} 

NonZero -> eight (1,1) (number=8 } 

NonZero -> nine (1,1) (number =9 } 

Digit -> Zero (1,1) {number=0 } 

Digit -> NonZero:n (1,1) { numbe r=Sn . number } 

TwentyToNinety -> twenty (1,1) (number=20 ! 

thirty (1,1) ( n umbe r = 3 0 } 
forty (1,1) {number =00 } 
fifty (1,1) {number =50 ) 
sixty (1,1) {number=60 i 
seventy (1,1) (number=70 } 
eighty (1,1) |number=80 I 
imber=90 } 



T w enty T o r s i n e t y - > 
TwentyToNinety -> 
TwentyToNinety -> 
TwentyToNinety -> 
TwentyToNinety -> 
TwentyToNinety -> 

TwentyToNinety -> ninety (1,1) {: 
Teen -> eleven (1,1) {number=il } 
Teen -> twelve (1,1) { numbe r = 1 2 \ 
Teen -> thirteen (1,1) { numbe 13 1 
Teen -> fourteen (1,1) |number~l<i } 
Teen -> fifteen (1,1) (number=15- } 
Teen -> sixteen (1,1) {number=16 1 
Teen -> seventeen (1,1) |number=17 } 
Teen -> eighteen (1,1) (number=18 } 
Teen -> nineteen (1,1) {number=19 } 
Teens -> ten (1,1) (number=10 } 

Teens -> TwentyToNinety : n (1,1) (number=Sn. number } 
Teens -> Teen:n (1,1) { number=$n . number } 
TwentySome -> TwentyToNinety : nl NonZero :n2 (1,1) 
n 2. number) } 

Teens -> TwentySome :n (1,1) I numbe r^Sn . number } 
UpToThousand -> Teens :n (1,1) I numbe r=$n . number ) 
UpToThousand -> NonZerom (1,1) I number-Sn . number ) 
HundredSlot -> hundred •( 1 , 1 ) (number = 100 } 
HundredSlot -> a hundred (1,1) fnumber=100 ) 

HundredSlot -> NonZero:n hundred (1,1) { number=mul ( $n . number 100) ) 
HundredToThousand -> HundredSlot : nl and UpToThousand : n2 (1,1) 

{ number^add ($nl . number $n2 . number) ) 
HundredToThousand -> HundredSlot : n 1 UpToThousand : n2 (1,1) 

{ r.umber = add ( $nl . number $n2. number) ) 

StrictHundredToThousand -> HundredSlot :n (1,1) i number=$n . number I 
St rictHundredToThousand -> HundredToThousand : n (1,1) { nurober=$n . number } 
Number -> ThousandToMi 1 1 i on : n (1,1) {numbe r=$n . number } 
ThousandToMillion -> a thousand (1,1) {number-1000 } 

ThousandSlot -> UpToTenThousand : n thousand (1,1) { numbe r=mul ( $n . number 
1000) } 



{ number=add ( $nl . number 
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! ThousandToMillion -> ThousandSlot : n (1,1) ( number=$n . number } 

! ThousandToMil lion -> ThousandAndSome : n (1,1) { number=$n . number } 

! ThousandAndSome -> ThousandSlot : n 1 UpToTenThousand : n2 (1,1) 

{ number=add ( $nl . number $n2. number) } 

! ThousandAndSome -> ThousandSlot : nl and UpToTenThousand : n2 (1,1) 
{ number=add ( $nl . number $n2. number) } 

! UpToTenThousand -> HundredSlot : n (1,1) ( number=$n . number } 

.'UpToTenThousand -> HundredToThousand : n (1,1) ( number=$n . number } 

! UpToTenThousand -> UpToThousand : n (1,1) { number=$n . number } 

! ThousandToMillion -> ManyHundred : n £1,1) ( number ~$n . number } 

! ThousandToMillion -> ManyHundred_and_some : n (1,1) { number=$n . number } 

.'ManyHundred -> Twent ySome : n hundred (1,1) { number=mul ( $n . number 100) } 

! ManyHundred -> Teen:n hundred (1,1) { number-mul ( $n . number 100) } 

! ManyHundred_and_some -> ManyHundred : nl UpToThousand : n2 (1,1) 

{ numbe r=add ($nl . number $n2. number) } 

! ManyHundred_and_some -> ManyHundred : n i and UpToThousand : n2 (1,1) 
{ number=add ( $nl . number $n2. number) } 

; -> The following rules set Che number modified. } 

; -> They float in this grammar but can be included as decected ) 

; -> by the model merging algorithm during the incorporation phase } 

! Number_modif ier -> less than (1,1) number . modi f ier=less_t nan } 

! Numbe r__modi f ier -> at most (1,1) I number . modi f ier=less_than ) 

! Number_modi f ier -> no more than (1,1) { numbe r . modi f ier=less_t han } 

! Number modi f ier -> greater than (1,1) { number . mcdifier=greater_than } 

! Mumber_modi f ier -> at least (1,1} I number . modi f ie r = grea ter_tnan } 

! Number_modi f i e r - > no less t ha n (1,1). { numbe r . modi t ,i. e r=g roa t e r_t han } 

i Numbe r_mod i f i e r - > all ( 1 , • J ( n umbe r . mod i f i e r -a 1 1 ) 

I Mumber_rnodi f ier - ;■■ every [ 1 , 1 ) ! number . mod i. i: ier=every } 
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Grammar generated by cools with predefined grammars included 
! CommonStockCmds -> CancelAct ions (1,1) { operat ion=cancel } 
! CommonStockCmds -> Repea tAction (1,1) { opera t ion=repeat } 
! CommonStockCmds -> Short HelpAct ions (1,1) ( operat ion=he Ip ) 
! CommonStockCmds -> QuitActions (1,1) { operat ion=quit } 
Stockname -> philp burns (1,1) { s tocknarne = "phi lp burns"' I 
Stockname -> philp burns (1,1) ( s tockname="phi Ip burns" } 
Stockname -> macquarie qanmacs (i,l) { stockname="rnacquarie qanmacs" } 
Stockname -> a i engineering (1,1) [scockname="a i engineering" } 
Stockname -> a p eagers limited (1,1) { stockname="a p eagers limited" 
Stockname -> a a p c limited (1,1) (1 stockname="a ape limited " } 
Stockname -> a a p t limited (1,1) I s tocknarne = "a apt limited" ) 
Stockname -> abador gold (1,1) (1 stockname="abador gold " } 
Stockname -> abednego nickel (i.,1) I s tockname="abednego nickel" ) 
Stockname -> aberfoyle limited {1,1} { s tockname="aber f oy le limited" } 
Stockname -> abigroup limited (1,1) { stockname- "abigroup limited" } 
Stockname -> arthur yates (1,1) (1 stockname="arthur yates " ) 
Stockname -> york securities (1,1) ( s tockname="yor k securities" } 
Stockname -> zeolite australia (1,1) { stocknarne = "zeolit s austraiia" ) 
Stockname -> zephyr minerals (1,1) {1 s tccknarne^ " zephyr minerals " ) 
Stockname -> z i com australia (1,1) I s tockname=" zicom australia" ) 
Stockname -> Zimbabwe platinum (1,1) I stockname* " Zimbabwe platinum' - " } 
Stockname -> zyictech limited (1,1) { stockname- " zylotech limited" } 
. Wa i t Re pi yAs kbu y s t oc k n ame 
I 



Monev : x 



pr ics . cent s = b ;•: . pi 



. Via it Re pi y A s k b u y s t o c k n a i n e 
s toe k name -$>: . stockname } 

. Wa i t Repl vAs kbuypr ice - > Commons toe kCmds : 
} 

. Wa i t Repl yAs kbu ypr ice - > 

price, doi iars = $x . price . dol .1 a r 
GR_buy -> Buy Noun (1,1) 
Buy Noun -> buy (1,1) 
. W a i t Re p 1 y A s k s e 1 1 s t o c k n a me 
|operat.ion = $c. operation } 
. Wait Repl yAs ksel 1. stock name -:• 
stockname=$x . stockname } 
. Wa i t Re pi yAs kbu y n umbe r 
) 

. Wa i t Re pi yAs kbu y number 
opera t ion=buynumber } 
. Wait Repl yAs ksel lnumber 
J 

. Wait Repl yAs ksel lnumber 
operation=sellnumber } 
. Wait ReplyAsksellprice 



CommonStockCmds : c (1,1) { ope rat ion-$c . operation 
> Stockname::-: (1,1) I ope ra t ion=buyst oc kname 



(1,1) I operat ion=$c . operation 



(1,1) 



{ operat ion =bu ypr ice 
e. cents } 



CommonStockCmds : c (1,1) 
Stockname : x (1,1) { operation=sells tockname 
CommonStockCmds : c < (1, 1) { opera tion=$c . operat ion 
-> Number :x (1,1) 1 number = $:-:. number 

CommonStockCmds : c (1,1) { opera tion=$c . operation 
-> Number :x (1,1) { number=$x . number 

CommonStockCmds : c (1,1) { opera t ion=$c . opera t ion 



. WaitReplyAsksellprice -> Money :x (1,1) { opera tion=sellprice 

price . dollars=$x . price . dollars price . cent s=$x . price . cents } 
GR_sell -> SellNoun (1,1) 
SellNoun -> sell (1,1) 

. WaitAskConf irmbuy -> CommonStockCmds : c (1,1) I operation=$c . operation } 

. Wa i t AskConf irmbuy -> Confirmations i 1 , ! } i ope ra t ion=Sc . con t irm } 

. WaitReplyAskConf irmseli -> CommonStockCmds : c (1,1) { operat ion=$c . operation 

! 

. WaitReplyAskConf irmseli -> Confirmation : c (1,1) I opera t ion = $c . con firm } 
. TopLevel Stock -> Commons toe kCmds : c (1,1' { opera t.ion=$c . opera t ion } 
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. TopLevelStock -> GR_buy (1,1) { opera c ion=buy } 
. TopLevelStock -> GR_sell (1,1) ( opera tion=sell } 

Number -> UpToHundred : n (1,1) { number = $n . number } 

UpToHundred -> Digit :n (1,1) { number=$n . number } 

UpToHundred -> Teens :n (1,1) { number=$n . number } 

Number -> S t ric t HundredToThousand : n (1,1) 1 number=$n . number } 

Zero -> zero (1,1) (number=0 } 

Zero -> nought (1,1) { number=0 } 

Zero -> oh (1,1) {number=0 } 

Zero - > no (1,1) {number=0 } 

NonZe.ro -> one (1.1) (number=l } 

MonZero -> two (1,1) I number = 2 } 

NonZero -> three (1,1) {number=3 } 

NonZero -> four (1,1) (number=4 } 

MonZero -> five (1,1) (number =5 } 

NonZero -> six (1,1) { number=6 } 

MonZero -> seven (1,1) 1 number = 7 } 

MonZero -> eight (1,1) |number=8 I 

NonZero -> nine (1,1) {number=9 } 

Digit -> Zero (1,1) { number =0 } 



Digit -r- NonZero :n (1,1) 



Twent yToNinet \ 
T w e n t y ToNinety 
T w ent y T o N i n e c y 
T w e n t y T o N met y 
Twent yToNinet y 
Twsn t yTcM i. ne ty 
T we n t y T o N i n e t y 
Twenty ToNinety 



i e e n 
Teen 
Teen 
Teen 
Teen 
Teen 
Teen 
Teen 
Teen 
Teens 
Teens -> 
Teens - > 



eleven i 
c w e i v e ( 
thirteen 
fourteen 
ii f teen 
sixteen 



twenty 
t h i r t y 
fort y 
fifty 
sixty 
seven;: 
eight y 
n .i. nee y 
1,1) Inu 
1 , 1 ) 
(1, 
(1,1) 
« 1 , 1 ) 
(1,1) 



{ numbs r = $n . numbe r 
£1,1} { number =2 0 I 
(1,1) ( number =30 ) 
(1,1) i number = 0 0 } 
(1,1) { number = 50 ! 
(1,1) ? number = 60 ) 
y (1,1) { n umbe r = 7 0 



( .-lumu-er- 



\ber- 1 1 
{ numbe r= 1 2 I 
) { numbe r= 13 
i numbe r- H 
• numbe r- \ b 
{ numbe r = 1 5 
) | .num.be r= 1 
( number- IS 
( number™ 19 



n u mb e r - 9 0 
1 



} 



s e v entsen (1,1 
eighteen < i , 1 ) 
nineteen (1,1) 
ten (1,1) ( number^ 1C } 

T we n t yToM i n e t y : n (1,1) ( n umbe r = $ n . numbe r 
een:n (1,1) ( nujiiber = $n . number } 



TwentySome -> Twent yToNinet y : nl NonZero: n2 (1,1) { number=add ( $n 1 . number 
$n 2. number) } 
! Teens - > Twent 
! UpToThousand - 
! UpToThousand - 
IHundredSlot -> 
! HundredSlot -> 
IHundredSlot -> 



} 



/Some : n (1,1) 1 numbe r=$n . number \ 

> Teens :n (1,1) { numbe r=$ n . number } 

> NonZero :n (1,1) { number=$n . number 
hundred (1,1) {number=100 } 
a hundred (1,1) {number=100 } 

NonZero :n hundred (1,1) { numbe r=mul ( $n . number 
! HundredToThousand -> Hundreds lot : n 1. and 
( number=add ( $nl . number $n2. number) } 
! HundredToThousand -> HundredSlot : n 1 

( number=add ( Snl . number $n2. number) } 
! StrictHundredToThousand -> HundredSlot : n (1,1) 



100) } 

UpToThousand : n2 (1,1) 
UpToThousand : n2 (1,1) 



rict HundredToThousand 



HundredToThousand : n 



{ number=$n . number } 
(1,1) { number=$n . number 
) 



! Number -> ThousandToMii lion : n (1,1) { number=Sn . number 
! ThousandToMillion -> a thousana (1,1) inumber=j000 } 

! Thousands Lot -> UpToTenThousand : n thousand (1,1) ( numbe r=mu 1 ( $n . number 
1000) } 

! TnousanoToMiilion -> ThousandSiot : n (1,1) |number=$n . number } 

! ThousandToMillion -> ThousandAndSome : n (1,1) { numbe r=$n . number } 
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! ThousandAndSome -> ThousandSlot : nl UpToTenThousand : n2 (1,1) 
{ number=add ($nl . number $n2 . number) } 

! ThousandAndSome -> ThousandSlot : nl and UpToTenThousand : n2 (1,1) 
{ number=add ($ni . number $n2. number) ) 

! UpToTenThousand -> HundredSlot : n (1,1) { number = $n . number } 

! UpToTenThousand -> HundredToThousand : n (1,1) { number=$n . number } 

! UpToTenThousand -> UpToThousand : n (1,1) { number=$n . number } 

! ThousandToMil lion -> ManyHundred : n (1,1) { number=$n . number } 

! ThousandToMil lion -> ManyHundred_and_some : n (1,1) { number=$n . number } 

! ManyHundred -> TwentySome:n hundred (1,1) ( numbe r=mul ( $n . number 100) } 

! ManyHundred -> Teen : n hundred (1,1) I number=mul ( $n . number 100) ) 

! ManyHundred_a nd_some -> ManyHundred : nl UpToThousand : n2 (1,1) 

( number=add ( Snl . number $n 2. number) } 

! ManyHundred and_some -> ManyHundred : nl and UpToThousand : n2 (1,1) 
[ number=add ( $ni . number Sn2. number) } 

; -> The following rules sec the number modified. } 

; -> They float in this grammar but can be included as detected } 

; -> by the model merging algorithm during the incorporation phase } 

INumber modifier Less than (1,1) { number . modi f ier=less_t han } 

! Number modifier -> ac mosc (1,1) ( number . modi f ier=less_than } 

! Number "modi fier -> no more than (1,1) ( number . modi f ier-less_than } 

! Number modifier -> greater than (1,1) ( number . modi f ier=grea ter_t han ) 

! Number~modi f ier -> at least (1,1) ( number . mocif ier=grea ter_than } 

! Numbe r~modi f ier -> no less than (1,1) ( number . modi fier=grea te r__t han ) 

! ■ Jumbe :." ~mca i f i e r - > a 11 CI, I > i numbe v . modi fier^aii } 

! Numbe r mod i f i e r - ■ e v e r y (1,1! { n u rube r . mod i f i e r =e ve ry } 

! Money - • Number :d DOLLARS UpToHundred : c (1,1) { price . cent s=$c . number 
price . dollars=Sd . number } 

•Money - -■ Number:-:: Honey2:c (1,1) (price . cenr.s = $c . price . cents 
pr ice . do 1 la rs = $d . number } 

! Money Number :d Mcney2: c CENTS (1,1) { price . cent s = $c . price . cents 

price . del iars-$d . number 1 

IMor.ev - *• UpToHunared : c CENTS { ■ . .1 ) ! price . cent s=$c . number price . dollars=0 
I 

! Money - > Numbe r : ci HOLLARS i 1 , 1 i I pr ice. cen t s = 0 p r i ce . do 1 la r s= So . numbe r } 

! Money2 -> DOLLARS cind UpToHundred:;; (1,1) { price . cenr.s = $c . number } 

! DOLLARS -> dollars (1,1) 

! DOLLARS -> dollar (1,1) 

! CENTS — cent (1,1) 

! CENTS -> cents (1,1) 
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CLAIMS: 

1 . A method of developing an interactive system, including: 

inputting application data representative of an application for said system, said 
5 application data including operations and parameters for said application; 
generating prompts on the basis of said application data; and . 
generating grammar on the basis of said application data. 



2. A method as claimed in claim 1 . wherein said prompts and grammar are generated on 
1 0 the basis of a predetermined pattern or structure Tor said prompts and grammar. 

3. A method as claimed in claim 2 wherein said grammar includes predefined grammar. 

4. A method as claimed in claim I . including generating a dialogue state machine on the 
15 basis of said application data. 

5. A method as claimed in claim 4. wherein said grammar and said state machine include 
slots defining data on which said interactive system executes the operations. 

20 6. A method as claimed in claim 5. wherein said slots include value data representing the 
meaning of phrase or term of a slot. 



7. A method as claimed in claim 6. wherein said application data is inputted in an 
application file, and the operations include a number of input and return parameters with 

25 parameter types. 

8. A method as claimed in any one of claims 3 and 5 to 7. including executing 
grammatical inference to enhance the grammar. 



30 



9. A method as claimed in claim 8. wherein executing said grammatical inference 
includes executing a model merging process, including: 
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processing rules of the grammar; 

generating additional rules representative of repeated phrases; and 

merging equivalent symbols of the grammar; 

wherein said rules define said slots and include said symbols. 

5 

10. A method as claimed in claim 9. wherein said rules include slot specification rules 
. including key value data representing the meaning of a phrase or term for a slot. 

11. A method as claimed in claim 9 or 1 0 : wherein said grammar is hierarchical and said 
10 rules include terminal and/or non-terminal symbols, whereby said rules refer to lower level 

rules to resolve non-terminal symbols. 

1 2. A method as claimed in claim 1 I . wherein said rule generating step includes generating 
a non-terminal symbol rule from correlated symbols and slot specification rules. 

15 

13. A method as claimed in claim 12 r wherein said merging step includes identifying 
interchangeable symbols on the basis of predetermined merging evidence patterns. 

14. A method as claimed in claim 13. wherein said merging step includes determining 
20 whether symbols to be merged have compatible slot specification rules and return 

corresponding slots. 

15. A method as claimed in claim 14 : wherein said rules include a hyperparameter 
representing use of the rule in observations parsed during said grammatical inference. 

25 

16. A method as claimed in claim 15, wherein said evidence patterns represent 
relationships between rules indicating a merger and corresponding rule formats to be generated 
when one of said relationships exist between said rules. 
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17. A method as claimed in claim 9 or 16, wherein said rules include a reference count 
representing the number of other rules that reference the rule. 

18. A method as claimed in claim 9 or 17, wherein said rules are determined on the basis 
5 of attribute constraints during said creating step. 

19. A grammatical inference method for developing grammar, including processing rules 
of the grammar, creating additional rules representative of repeated phrases, and merging 
equivalent symbols of the grammar, wherein said rules define slots to represent data on which 

10 an interactive system executes operations and include symbols representing at least a phrase 
or term. 

20. A method as claimed in claim 19, wherein said rules include slot specification rules 
including key value data representing the meaning of a phrase or term for a slot. 

15 

21. A method as claimed in claim 19 or 20, wherein said grammar is hierarchical and said 
rules include terminal and/or non-terminal symbols, whereby said rules refer to lower level 
rules to resolve non-terminal symbols. 

20 22. A method as claimed in claim 2 1 , wherein said rule generating step includes generating 
a non-terminal symbol rule from correlated symbols and slot specification rules. 

23. A method as claimed in claim 21, wherein said merging step includes identifying 
interchangeable symbols on the basis of predetermined merging evidence patterns. 

25 

24. A method as claimed in claim 23, wherein said merging step includes determining' 
whether symbols to be merged have compatible slot specification rules and return 
corresponding slots. 



WO 00/78022 



PCT/AUOO/00651 



- 81 - 

25. A method as claimed in claim 21, wherein said rules include a hyperparameter 
representing use of the rule in observations parsed during said grammatical inference. 

26. A method as claimed in claim 23, wherein said evidence patterns represent 
5 relationships between rules indicating a merger and corresponding rule formats to be generated 

when one of said relationships exist between said rules. 

27. A method as claimed in claim 19, wherein said rules include a reference count 
representing the number of other rules that reference the rule. 

10 

28. A method as claimed in claim 19 : wherein said rules are determined on the basis of 
attribute constraints during said creating step. 

29. A development tool for an interactive system having code for executing the steps of 
I 5 the method as claimed in any one of claims 1 to 28. 

30. An interactive system developed using the method as claimed in any one of claims 1 
to 28. 

20 31. A system for developing an interactive system, including: 

means for inputting application data representative of an application for said system, 
said application data including operations and parameters for said application; 
means for generating prompts on the basis of said application data; and 
means for generating grammar on the basis of said application data. 

25 

32. A development tool for an interactive system, including: 

code for inputting application data representative of an application for said system, 
said application data including operations and parameters for said application; 

code for generating prompts on the basis of said application data: and 
30 code for generating grammar on the basis of said application data. 
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'Add current, 
nonterminal to 
symboljist' 



FPAR IN current_nonterminal INTEGER 
symboljist Category_Sequenee, 
IN/OUT 

recursive BOOLEAN; 
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'Get next rule with 
nonterm on LHS' 
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